-- Logs begin at Tue 2022-05-10 16:54:01 UTC, end at Tue 2022-05-10 18:12:27 UTC. -- May 10 17:35:32.570702 dv-cinder-841302-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 17:35:32.580179 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 17:35:32.582226 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 17:35:32 2022] *** May 10 17:35:32.582226 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 17:35:32.582226 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 17:35:32.582226 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: nodename: dv-cinder-841302-2-iscsi May 10 17:35:32.582226 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: machine: x86_64 May 10 17:35:32.582226 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: clock source: unix May 10 17:35:32.582226 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: pcre jit disabled May 10 17:35:32.582226 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: detected number of CPU cores: 4 May 10 17:35:32.582226 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: current working directory: / May 10 17:35:32.582226 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: detected binary path: /usr/bin/uwsgi-core May 10 17:35:32.582924 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: your processes number limit is 47680 May 10 17:35:32.582924 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: your memory page size is 4096 bytes May 10 17:35:32.582924 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: detected max file descriptor number: 2048 May 10 17:35:32.582924 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: lock engine: pthread robust mutexes May 10 17:35:32.582924 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: thunder lock: enabled May 10 17:35:32.582924 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 17:35:32.582924 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 17:35:32.627332 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: Python main interpreter initialized at 0x55b17c0c29c0 May 10 17:35:32.627332 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: python threads support enabled May 10 17:35:32.627332 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: your server socket listen backlog is limited to 100 connections May 10 17:35:32.627332 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: your mercy for graceful operations on workers is 90 seconds May 10 17:35:32.627741 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: mapped 403077 bytes (393 KB) for 2 cores May 10 17:35:32.627817 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: *** Operational MODE: preforking *** May 10 17:35:32.628040 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: *** uWSGI is running in multiple interpreter mode *** May 10 17:35:32.628040 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: spawned uWSGI master process (pid: 109411) May 10 17:35:32.628253 dv-cinder-841302-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 17:35:32.629031 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: spawned uWSGI worker 1 (pid: 109412, cores: 1) May 10 17:35:32.629139 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: spawned uWSGI worker 2 (pid: 109413, cores: 1) May 10 17:35:32.629665 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 17:35:33.842073 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 17:35:33.843008 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 17:35:34.581431 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:35:34.581431 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: from cryptography.utils import int_from_bytes May 10 17:35:34.581755 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:35:34.581755 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: from cryptography.utils import int_from_bytes May 10 17:35:34.589369 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:35:34.589369 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: from cryptography.utils import int_from_bytes May 10 17:35:34.589693 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:35:34.589693 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: from cryptography.utils import int_from_bytes May 10 17:35:37.184106 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 17:35:37.184770 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 17:35:37.184876 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 17:35:37.185219 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 17:35:37.185301 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 17:35:37.185375 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 17:35:37.185450 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 17:35:37.185522 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 17:35:37.185842 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.185940 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 17:35:37.186098 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 17:35:37.186195 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.186491 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.186588 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.186813 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.186916 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.187132 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.187224 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.187474 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.187575 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.187800 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.187893 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.188108 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.188191 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.188429 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.188523 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.188692 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.188798 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.189009 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.189102 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.189326 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.189473 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841302-2-iscsi {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.189642 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.189798 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.189951 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.190038 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841302-2-iscsi {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.190265 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.190365 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.190571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.190665 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.190879 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.190966 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.191471 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.191579 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.191779 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.191872 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.192097 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.192281 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.192392 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.192730 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.192893 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.193028 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.193201 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.193337 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.193528 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.193677 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.193852 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.193989 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.194132 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.194289 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.195078 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.195242 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.195329 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.195434 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.195527 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.196117 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.196215 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.196215 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.196408 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.196495 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.196588 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841302-2-iscsi {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.196673 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841302-2-iscsi {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.196783 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.196877 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.197006 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.197151 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.197237 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.197461 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.197578 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.197865 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.197954 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.198176 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.198260 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.198483 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.198575 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.198802 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.198896 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.199107 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.199206 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.199446 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.199575 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.199776 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.199931 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.200090 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.200190 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.200408 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.200494 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.200714 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.200808 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.201009 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.201107 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.201313 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.201409 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.201619 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.201704 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.201922 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.202013 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.202223 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.202318 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.202478 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.202564 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.202762 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.202849 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.203065 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.203154 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.203417 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.203519 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.203760 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.203865 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.204018 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.204100 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.204228 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.204322 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.204511 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.204596 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.204828 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.204956 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.205136 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.205231 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.205436 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.205522 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.205738 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.205831 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.206037 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.206125 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.206327 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.206423 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.206627 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.206722 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.206977 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.207064 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.207291 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.207394 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.207618 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.207706 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.207935 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.208022 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.208246 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.208344 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.208565 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.208660 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.208873 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.208969 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.209189 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.209275 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.209537 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.209661 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.209823 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.209921 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.210126 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.210228 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.210461 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.210566 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.210772 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.210866 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.211074 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.211165 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.211410 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.211518 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.211719 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.211806 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.212022 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.212107 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.212348 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.212439 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.212672 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.212797 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.212985 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.213071 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.213290 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.213377 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.213543 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.213677 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.213845 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.213930 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.214149 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.214241 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.214466 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.214553 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.214774 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.214859 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.215080 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.215167 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.215395 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.215482 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.215700 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.215787 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.215996 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.216082 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.216298 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.216383 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.216598 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.216692 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.216900 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.216992 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.217199 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.217284 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.217503 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.217596 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.217804 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.217889 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.218107 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.218208 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.218409 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.218507 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.218712 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.218799 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.219030 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.219114 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.219338 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.219582 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.219727 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.219825 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.219956 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.220042 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.220258 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.220376 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.220563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.220653 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.220880 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.220968 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.221183 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.221279 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.221487 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.221573 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.221803 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.221933 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.222107 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.222206 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.222409 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.222500 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.222725 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.222819 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.223027 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.223121 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.223329 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.223447 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.223656 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.223741 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.223952 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.224045 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.224255 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.224341 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.224558 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.224651 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.224858 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.224952 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.225161 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.225247 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.225462 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.225549 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.225764 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.225852 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.226065 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.226150 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.226365 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.226450 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.226663 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.226755 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.226960 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.227056 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.227256 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.227349 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.227595 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.227683 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.228439 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.228571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.228857 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.228955 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.229168 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.229321 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.229492 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.229602 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.229833 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.229931 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:35:37.230168 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.230261 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.230513 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.230611 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.230828 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.230923 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.231161 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.231249 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.231520 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.231612 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.231843 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.231939 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.232157 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.232254 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.232475 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.232570 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.232786 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.232879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.233110 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.233195 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.233419 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.233511 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.233730 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.233817 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.234041 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.234127 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.234356 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.234451 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.234669 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.234766 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.234989 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.235075 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.235301 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.235408 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.235641 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.235739 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.235956 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.236043 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.236265 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.236359 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.236578 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.236665 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.236898 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.236990 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.237210 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.237306 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.237517 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.237641 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.237856 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.237942 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.238183 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.238281 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.238495 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.238588 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.238818 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.238916 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.239129 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.239227 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.239468 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.239560 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.239780 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.239880 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.240093 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.240189 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.240505 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.240727 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.240822 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.241050 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.241139 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.241364 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.241448 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.241673 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.241760 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.241983 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.242068 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.242290 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.242386 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.242599 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.242685 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.242904 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.242991 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.243241 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.243335 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.243667 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.244280 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.244531 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.244673 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.244849 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.244993 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.245163 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.245307 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.245476 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.245626 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.245788 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.245943 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.246098 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.246253 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.246401 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.246560 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.246703 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.246867 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.247006 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.247181 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.247315 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.247513 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.247642 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.247835 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.247961 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.248167 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.248286 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.248478 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.248590 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.248813 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.248908 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.249124 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.249218 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.249438 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.249532 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.249751 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.249844 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.250062 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.250157 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.250372 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.250458 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.250686 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.250786 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.250995 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.251080 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.251299 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.251405 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.251684 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.251790 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.251965 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.252062 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.252272 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.252400 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.252597 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.252736 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.252903 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.252988 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.253208 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.253294 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.253522 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.253609 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.253831 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.253917 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.254138 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.254234 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.254493 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.254591 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.254755 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.254841 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.255079 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.255176 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.255406 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.255496 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.255724 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.255823 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.256057 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.256158 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.256382 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.256466 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.256683 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.256776 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.257005 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.257089 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.257325 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.257410 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.257638 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.257723 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.257939 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.258037 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.258248 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.258336 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.258551 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.258678 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.258932 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.259042 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.259208 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.259459 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.259598 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.259761 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.259859 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.259951 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.260172 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.260283 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.260478 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.260566 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.260782 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.260879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.261086 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.261172 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.261407 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.261493 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.261718 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.261807 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.262020 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.262106 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.262320 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.262468 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.262622 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.262715 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.262962 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.263051 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.263266 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.263394 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.263629 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.263716 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.263963 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.264048 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.264278 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.264375 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.264600 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.264685 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.264910 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.264994 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.265223 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.265321 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.265531 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.265616 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.265840 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.265925 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.266147 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.266245 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.266455 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.266547 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.266771 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.266857 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.267080 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.267174 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.267933 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.268041 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.268122 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.268201 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.268300 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.268382 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.268461 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.268539 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.268643 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.268738 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.268947 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.269034 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.269260 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.269346 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.269599 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.269685 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.269928 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.270021 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.270244 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.270351 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.270560 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.270646 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.270869 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.270968 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.271179 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.271264 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.271512 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.271613 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.271821 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.271906 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.272124 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.272209 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.272433 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.272528 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.272746 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.272836 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.273053 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.273139 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.273369 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.273463 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.273674 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.273767 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.273995 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.274082 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.274300 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.274393 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.274612 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.274706 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.274966 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.275079 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.275272 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.275395 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.275619 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.275706 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.275950 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.276038 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.276259 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.276354 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.276566 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.276655 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.276883 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.276980 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.277190 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.277278 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.277495 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.277589 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.277803 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.277897 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.278105 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.278193 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.278407 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.278494 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.278711 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.278804 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.279021 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.279108 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.279332 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.279466 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.279729 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.279830 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.280034 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.280120 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.280370 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.280470 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.280647 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.280744 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.280950 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.281037 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.281251 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.281337 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.281560 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.281656 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.281880 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.281973 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.282187 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.282273 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.282505 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.282640 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.282823 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.282909 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.283123 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.283209 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.283450 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.283540 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.283771 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.283864 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.284078 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.284172 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.284379 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.284466 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.284678 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.284763 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.284977 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.285053 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.285317 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.285405 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.285626 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.285712 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.285927 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.286012 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.286240 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.286339 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.286559 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.286644 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.286864 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.286957 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.287177 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.287263 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.287510 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.287599 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.287822 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.287920 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.288144 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.288230 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.288453 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.288544 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.288762 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.288856 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.289067 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.289153 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.289377 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.289469 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.289683 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.289784 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.289993 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.290078 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.290312 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.290927 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.291145 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.291294 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.291480 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.291636 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.291871 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.291960 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.292224 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.292302 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.292536 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.292628 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.292855 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.292942 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.293440 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.293529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.293770 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.293856 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.294083 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.294169 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.294403 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.294497 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.294721 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.294806 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.295038 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.295132 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.295402 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.295492 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.295717 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.295803 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.296060 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.296168 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.296367 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.296529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.296675 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.296770 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.296980 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.297066 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.297284 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.297381 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.297593 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.297681 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.297895 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.297980 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.298197 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.298291 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.298500 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.298587 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.298808 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.298894 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.299110 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.299203 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.299429 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.299531 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.299734 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.299828 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.300038 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.300133 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.300353 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.300439 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.300655 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.300748 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.300967 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.301070 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.301271 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.301377 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.301593 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.301678 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.301899 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.301988 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.302201 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.302294 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.302501 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.302586 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.302804 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.302940 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.303144 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.303238 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.303478 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.303569 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.303853 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.303950 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.304142 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.304228 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.304480 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.304567 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.304785 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.304873 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.305087 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.305180 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.305413 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.305510 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.305715 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.305802 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.306133 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.306764 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.306945 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.307048 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.307259 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.307354 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.307638 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.307754 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.307942 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.308044 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.308251 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.308338 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.308559 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.308645 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.308868 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.308963 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.309177 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.309264 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.309478 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.309565 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.309788 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.309876 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.310091 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.310176 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.310403 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.310489 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.310708 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.310795 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.311010 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.311103 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.311315 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.311452 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.311647 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.311748 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.311953 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.312038 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.312254 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.312340 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.312561 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.312649 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.312859 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.312987 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.313172 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.313268 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.313472 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.313557 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.313772 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.313858 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.314074 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.314167 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.314378 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.314463 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.314683 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.314775 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.314983 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.315081 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.315305 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.315429 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.315641 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.315740 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.315941 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.316293 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.316496 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.316590 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.316802 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.316895 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.317105 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.317202 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.317405 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.317491 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.317711 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.317800 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.318031 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.318119 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.318347 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.318433 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.318649 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.318735 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.318958 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.319046 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.319258 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.319344 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.319585 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.319673 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.319893 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.319988 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.320198 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.320291 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.320498 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.320609 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.320798 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.320886 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.321099 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.321186 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.321417 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.321555 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.321740 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.321834 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.322071 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.322158 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.322382 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.322479 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.322717 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.322841 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.323021 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.323161 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.323323 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.323486 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.323691 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.323814 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.323997 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.324124 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.324354 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.324484 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.324661 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.324793 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.324973 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.325111 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.325284 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.325434 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.325589 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.325748 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.325898 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.326059 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.326208 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.326373 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.326510 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.326678 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.326823 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.326990 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.327130 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.327300 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.327462 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.327641 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.327768 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.327948 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.328070 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.328252 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.328390 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.328576 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.328699 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.328886 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.329007 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.329197 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.329326 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.329520 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.329647 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.329846 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.329980 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.330173 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.330286 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.330481 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.330595 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.330792 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.330905 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.331103 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.331213 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.331433 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.331552 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.331747 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.331880 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.332057 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.332192 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.332369 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.332504 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.332681 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.332813 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.332991 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.333124 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.333302 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.333441 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.333617 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.333747 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.333924 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.334042 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.334235 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.334332 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.334546 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.334632 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.334851 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.334939 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.335175 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.335271 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.335507 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.335597 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.335812 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.335898 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.336121 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.336219 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.336424 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.336510 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.336724 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.336811 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.337026 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.337161 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.337522 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.337628 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.337844 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.337931 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.338147 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.338235 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.338456 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.338544 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.338765 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.338851 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.339072 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.339159 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.339394 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.339485 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.339702 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.339801 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.340003 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.340122 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.340426 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.340524 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.340731 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.340826 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.341036 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.341125 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.341337 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.341423 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.341637 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.341783 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.341939 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.342032 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.342245 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.342333 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.342547 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.342687 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.342851 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.342951 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.343151 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.343237 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.343484 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.343574 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.343816 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.343902 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.344121 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.344207 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.344441 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.344538 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.344836 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.344971 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.345146 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.345240 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.345473 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.345569 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.345855 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.345950 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.346165 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.346269 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.346482 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.346573 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.346800 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.346885 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.347120 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.347218 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.347448 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.347554 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.347764 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.347860 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.348075 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.348161 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.348384 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.348478 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.348706 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.348793 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.349014 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.349101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.349324 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.349423 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.349626 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.349711 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.349931 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.350019 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.350256 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.350357 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.350563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.350656 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.350875 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.350961 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.351199 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.351296 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.351614 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.351703 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.351927 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.352025 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.352247 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.352336 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.352566 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.352651 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.352868 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.353489 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.353733 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.353853 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.354041 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.354247 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.354350 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.354562 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.354649 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.354871 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.354958 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.355201 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.355308 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.355532 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.355635 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.355845 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.355932 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.356155 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.356249 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.356464 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.356552 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.356765 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.356851 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.357067 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.357160 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.357386 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.357480 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.357688 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.357774 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.358006 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.358093 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.358317 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.358412 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.358636 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.358785 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.358956 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.359042 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.359257 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.359344 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.359600 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.359689 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.359909 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.360016 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.360211 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.360299 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.360514 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.360600 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.360813 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.360907 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.361154 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.361248 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.361457 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.361543 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.361775 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.361874 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.362102 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.362188 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.362429 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.362515 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.362736 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.362830 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.363065 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.363151 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.363397 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.363488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.363719 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.363815 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.364040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.364152 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.364930 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.365047 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.365047 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.365266 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.365482 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.365566 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.365658 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.365740 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.365740 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.365965 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.366053 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.366130 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.366198 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.366285 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.366404 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.366500 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.366704 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.366801 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.367002 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.367099 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.367300 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.367403 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.367644 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.367733 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.367944 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.368040 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.368261 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.368347 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.368632 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.369227 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.369503 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.369622 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.369810 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.369939 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.370113 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.370247 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.370455 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.370590 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.370764 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.370896 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.371096 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.371234 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.371439 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.371584 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.371764 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.371909 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.372090 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.372238 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.372401 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.372552 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.372723 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.372877 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.373038 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.373194 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.373351 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.373511 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.373663 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.373828 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.373978 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.374150 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.374293 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.374467 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.374608 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.374786 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.374921 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.375104 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.375231 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.375439 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.375569 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.375760 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.375883 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.376079 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.376200 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.376398 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.376765 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.376956 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.377091 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.377284 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.377404 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.377599 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.377714 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.377916 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.378024 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.378230 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.378319 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.378546 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.378632 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.378858 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.378964 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.379171 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.379266 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.379507 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.379599 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.379820 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.379924 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.380133 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.380221 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.380460 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.380549 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.380781 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.380876 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.381108 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.381195 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.381424 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.381510 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.381738 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.381827 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.382052 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.382138 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.382363 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.382449 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.382679 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.382767 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.383021 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.383115 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.383329 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.383451 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.383662 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.383757 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.383974 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.384072 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.384353 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.384455 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.384673 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.384760 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.384985 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.385156 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.385297 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.385479 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.385614 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.385794 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.385930 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.386105 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.386242 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.386416 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.386555 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.386728 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.386870 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.387044 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.387187 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.387387 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.387555 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.387725 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.387892 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.388042 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.388211 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.388352 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.388525 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.388664 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.388839 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.388975 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.389233 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.389519 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.389688 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.389837 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.390004 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.390172 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.390337 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.390499 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.390662 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.390830 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.390986 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.391147 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.391302 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.391491 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.391645 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.391820 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.391972 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.392139 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.392288 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.392444 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.392598 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.392755 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.392902 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.393061 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.393211 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.393363 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.393515 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.393683 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.393836 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.393997 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.394150 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.394295 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.394453 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.394613 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.394773 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.394921 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.395084 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.395476 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.395652 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.395883 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.396004 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.396139 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.396314 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.396445 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.396646 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.396769 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.396976 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.397084 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.397301 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.397423 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.397606 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.397703 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.397933 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.398020 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.398242 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.398329 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.398550 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.398646 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.398867 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.399004 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.399168 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.399298 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.399491 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.399589 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.399822 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.399923 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.400251 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.400347 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.400570 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.400670 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.400874 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.400961 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.401186 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.401281 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.401494 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.401582 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.401802 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.401888 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.402108 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.402213 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.402410 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.402506 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.402719 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.402866 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.403020 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.403123 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.403321 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.403451 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.403649 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.403736 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.403993 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.404140 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.404255 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.404342 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.404555 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.404647 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.404857 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.404961 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.405158 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.405252 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.405458 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.405596 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.405758 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.405854 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.406058 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.406144 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.406369 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.406459 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.406714 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.406804 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.407019 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.407097 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.407321 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.407427 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.407662 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.407752 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.407970 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.408056 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.408279 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.408364 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.408587 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.408675 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.408896 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.408982 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.409204 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.409290 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.409545 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.409633 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.409860 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.410086 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.410403 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.410499 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.410724 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.410811 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.411042 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.411128 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.411490 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.411596 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.411710 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.411797 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.412016 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.412109 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.412321 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.412417 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.412644 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.412731 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.412954 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.413041 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.413266 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.413355 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.413575 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.413670 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.413883 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.413971 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.414193 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.414294 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.414501 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.414635 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.414808 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.414895 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.415115 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.415204 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.415963 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.416077 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.416282 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.416388 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.416591 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.416842 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.416938 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.417168 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.417263 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.417485 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.417575 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.417825 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.417911 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.418139 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.418235 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.418454 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.418541 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.418764 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.418849 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.419077 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.419164 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.419419 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.419524 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.419712 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.419807 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.420016 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.420113 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.420324 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.420419 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.420633 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.420720 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.420971 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.421068 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.421281 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.421375 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.421583 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.421669 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.422000 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.422096 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.422312 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.422409 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.422629 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.422717 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.422948 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.423044 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.423256 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.423344 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.423600 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.423690 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.423923 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.424011 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.424229 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.424369 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.424550 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.424647 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.424857 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.424954 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.425182 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.425269 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.425516 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.425676 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.425841 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.425929 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.426165 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.426252 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.426467 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.426567 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.426769 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.426855 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.427076 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.427220 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.427400 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.427508 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.427721 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.427808 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.428028 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.428116 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.428328 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.428424 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.428630 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.428717 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.428934 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.429021 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.429234 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.429330 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.429536 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.429631 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.429838 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.429934 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.430139 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.430227 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.430442 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.430528 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.430741 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.430835 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.431063 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.431176 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.431518 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.431652 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.431828 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.431960 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.432135 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.432264 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.432439 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.432567 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.432752 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.432875 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.433057 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.433176 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.433363 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.433483 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.433667 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.433786 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.433970 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.434087 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.434319 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.434463 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.434611 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.434708 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.434945 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.435036 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.435263 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.435351 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.435612 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.435705 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.435924 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.436012 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.436246 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.436332 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.436555 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.436651 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.436871 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.436957 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.437191 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.437288 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.437504 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.437602 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.437810 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.437897 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.438137 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.438230 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.438447 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.438543 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.438757 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.438845 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.439067 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.439163 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.439390 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.439481 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.439699 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.439786 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.440007 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.440112 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.440331 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.440418 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.440650 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.440745 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.440953 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.441300 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.441530 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.441618 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.441849 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.441935 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.442168 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.442257 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.442481 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.442568 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.442787 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.442873 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.443114 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.443205 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.443446 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.443550 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.443758 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.443844 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.444072 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.444160 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.444380 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.444466 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.444691 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.444788 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.445007 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.445098 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.445324 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.445419 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.445649 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.445744 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.445973 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.446063 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.446295 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.446381 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.446621 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.446735 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.447037 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.447132 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.447352 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.447458 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.447720 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.447818 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.448049 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.448194 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.448365 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.448510 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.448679 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.448822 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.448984 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.449129 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:35:37.449216 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 17:35:37.449373 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109413) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 17:35:37.473318 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_db.sqlalchemy.engines [None req-540e8a77-625c-42e7-b301-9561dbf9c8c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109413) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:35:37.475773 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG oslo_db.sqlalchemy.engines [None req-eb0a458e-b8e9-4ca0-98b7-c8c6fc40f5d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109412) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:35:37.537841 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.context [None req-540e8a77-625c-42e7-b301-9561dbf9c8c6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87(cell1) {{(pid=109413) load_cells /opt/stack/nova/nova/context.py:464}} May 10 17:35:37.542968 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.context [None req-eb0a458e-b8e9-4ca0-98b7-c8c6fc40f5d3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87(cell1) {{(pid=109412) load_cells /opt/stack/nova/nova/context.py:464}} May 10 17:35:37.543112 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-540e8a77-625c-42e7-b301-9561dbf9c8c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:35:37.544736 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-540e8a77-625c-42e7-b301-9561dbf9c8c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:35:37.545535 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-540e8a77-625c-42e7-b301-9561dbf9c8c6 None None] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:35:37.547518 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-540e8a77-625c-42e7-b301-9561dbf9c8c6 None None] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:35:37.547773 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG oslo_concurrency.lockutils [None req-eb0a458e-b8e9-4ca0-98b7-c8c6fc40f5d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:35:37.549408 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG oslo_concurrency.lockutils [None req-eb0a458e-b8e9-4ca0-98b7-c8c6fc40f5d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:35:37.550237 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG oslo_concurrency.lockutils [None req-eb0a458e-b8e9-4ca0-98b7-c8c6fc40f5d3 None None] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:35:37.552381 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG oslo_concurrency.lockutils [None req-eb0a458e-b8e9-4ca0-98b7-c8c6fc40f5d3 None None] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:35:37.559027 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_db.sqlalchemy.engines [None req-540e8a77-625c-42e7-b301-9561dbf9c8c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109413) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:35:37.562361 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_db.sqlalchemy.engines [None req-540e8a77-625c-42e7-b301-9561dbf9c8c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109413) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:35:37.566632 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG oslo_db.sqlalchemy.engines [None req-eb0a458e-b8e9-4ca0-98b7-c8c6fc40f5d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109412) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:35:37.569885 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG oslo_db.sqlalchemy.engines [None req-eb0a458e-b8e9-4ca0-98b7-c8c6fc40f5d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109412) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:35:37.725326 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_db.sqlalchemy.engines [None req-540e8a77-625c-42e7-b301-9561dbf9c8c6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109413) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:35:37.730749 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG oslo_db.sqlalchemy.engines [None req-eb0a458e-b8e9-4ca0-98b7-c8c6fc40f5d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109412) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:35:38.067672 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: WARNING keystonemiddleware.auth_token [None req-540e8a77-625c-42e7-b301-9561dbf9c8c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 17:35:38.075138 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: WARNING keystonemiddleware.auth_token [None req-eb0a458e-b8e9-4ca0-98b7-c8c6fc40f5d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 17:35:38.075702 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: WARNING keystonemiddleware.auth_token [None req-540e8a77-625c-42e7-b301-9561dbf9c8c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 17:35:38.082567 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: WARNING keystonemiddleware.auth_token [None req-eb0a458e-b8e9-4ca0-98b7-c8c6fc40f5d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 17:35:38.427379 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: WARNING keystonemiddleware.auth_token [None req-540e8a77-625c-42e7-b301-9561dbf9c8c6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 17:35:38.434359 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: WARNING keystonemiddleware.auth_token [None req-540e8a77-625c-42e7-b301-9561dbf9c8c6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 17:35:38.435241 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: WARNING keystonemiddleware.auth_token [None req-eb0a458e-b8e9-4ca0-98b7-c8c6fc40f5d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 17:35:38.441288 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b17c0c29c0 pid: 109413 (default app) May 10 17:35:38.442282 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: WARNING keystonemiddleware.auth_token [None req-eb0a458e-b8e9-4ca0-98b7-c8c6fc40f5d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 17:35:38.443611 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-540e8a77-625c-42e7-b301-9561dbf9c8c6 None None] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:35:38.444913 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-540e8a77-625c-42e7-b301-9561dbf9c8c6 None None] 10.222.0.60 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001909 May 10 17:35:38.445334 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 1/1] 10.222.0.60 () {50 vars in 788 bytes} [Tue May 10 17:35:38 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:35:38.449431 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b17c0c29c0 pid: 109412 (default app) May 10 17:36:59.253241 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-540e8a77-625c-42e7-b301-9561dbf9c8c6 None None] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:59.254231 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-540e8a77-625c-42e7-b301-9561dbf9c8c6 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 May 10 17:36:59.254631 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 2/2] 10.222.0.60 () {54 vars in 930 bytes} [Tue May 10 17:36:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:36:59.710447 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-c46460bd-042d-4cf4-80cb-4ff7da3358e8 admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:36:59.740237 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-c46460bd-042d-4cf4-80cb-4ff7da3358e8 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.477036 May 10 17:36:59.741331 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 1/3] 10.222.0.60 () {60 vars in 1291 bytes} [Tue May 10 17:36:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:37:02.089822 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-540e8a77-625c-42e7-b301-9561dbf9c8c6 None None] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:02.090821 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-540e8a77-625c-42e7-b301-9561dbf9c8c6 None None] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 May 10 17:37:02.091210 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 3/4] 10.222.0.60 () {54 vars in 930 bytes} [Tue May 10 17:37:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:37:02.198738 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-a21924e3-f3b6-4917-abd2-cb7eec9799b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "ram": 256, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:02.235000 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:37:02.235000 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: warnings.warn(msg) May 10 17:37:02.287186 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-a21924e3-f3b6-4917-abd2-cb7eec9799b5 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.184728 May 10 17:37:02.289551 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 2/5] 10.222.0.60 () {64 vars in 1282 bytes} [Tue May 10 17:37:02 2022] POST /compute/v2.1/flavors => generated 407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:37:02.531692 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-ec81f92c-2fad-4e11-90e6-3a9c5ba19b6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:02.534199 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:37:02.534199 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: warnings.warn(msg) May 10 17:37:02.586949 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-ec81f92c-2fad-4e11-90e6-3a9c5ba19b6d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285507 May 10 17:37:02.588276 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 4/6] 10.222.0.60 () {64 vars in 1335 bytes} [Tue May 10 17:37:02 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:37:05.010438 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-a21924e3-f3b6-4917-abd2-cb7eec9799b5 admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:05.011493 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-a21924e3-f3b6-4917-abd2-cb7eec9799b5 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 May 10 17:37:05.011900 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 3/7] 10.222.0.60 () {54 vars in 930 bytes} [Tue May 10 17:37:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:37:05.125269 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-6d9a7c2e-3ac6-43b7-8daa-a90cff442dc2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "name": "ds512M", "id": "d1", "ram": 512, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:05.144455 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:37:05.144455 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: warnings.warn(msg) May 10 17:37:05.169902 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-6d9a7c2e-3ac6-43b7-8daa-a90cff442dc2 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.147531 May 10 17:37:05.175435 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 5/8] 10.222.0.60 () {64 vars in 1282 bytes} [Tue May 10 17:37:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:37:05.183701 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-7d58cfa7-64bc-490b-ba50-a0deadba4555 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:05.185217 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:37:05.185217 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: warnings.warn(msg) May 10 17:37:05.230347 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-7d58cfa7-64bc-490b-ba50-a0deadba4555 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050446 May 10 17:37:05.231211 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 4/9] 10.222.0.60 () {64 vars in 1335 bytes} [Tue May 10 17:37:05 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:37:07.896914 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-6d9a7c2e-3ac6-43b7-8daa-a90cff442dc2 admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:07.898524 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-6d9a7c2e-3ac6-43b7-8daa-a90cff442dc2 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002061 May 10 17:37:07.899673 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 6/10] 10.222.0.60 () {54 vars in 930 bytes} [Tue May 10 17:37:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:37:07.980165 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-fd868123-c2bf-44c7-a26f-3950f0e89aab admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 1024, "id": "d2", "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0}} {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:07.998595 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-fd868123-c2bf-44c7-a26f-3950f0e89aab admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.092818 May 10 17:37:07.999420 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 5/11] 10.222.0.60 () {64 vars in 1282 bytes} [Tue May 10 17:37:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:37:08.013290 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-77c8a540-2e7d-432f-ae10-e0fc7dc89914 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:08.039347 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-77c8a540-2e7d-432f-ae10-e0fc7dc89914 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030806 May 10 17:37:08.040132 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 7/12] 10.222.0.60 () {64 vars in 1335 bytes} [Tue May 10 17:37:08 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:37:10.405564 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-fd868123-c2bf-44c7-a26f-3950f0e89aab admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:10.406948 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-fd868123-c2bf-44c7-a26f-3950f0e89aab admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 May 10 17:37:10.406948 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 6/13] 10.222.0.60 () {54 vars in 930 bytes} [Tue May 10 17:37:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:37:10.474873 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-0892988e-a6e6-4eda-9ab0-dfb2e2cec643 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "id": "d3", "ram": 2048}} {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:10.496132 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-0892988e-a6e6-4eda-9ab0-dfb2e2cec643 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082868 May 10 17:37:10.496695 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 8/14] 10.222.0.60 () {64 vars in 1282 bytes} [Tue May 10 17:37:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:37:10.510048 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-0a296329-4021-4ad4-87f8-9c1c557b7a47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:10.534043 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-0a296329-4021-4ad4-87f8-9c1c557b7a47 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028440 May 10 17:37:10.534807 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 7/15] 10.222.0.60 () {64 vars in 1335 bytes} [Tue May 10 17:37:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:37:12.891578 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-0892988e-a6e6-4eda-9ab0-dfb2e2cec643 admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:12.892590 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-0892988e-a6e6-4eda-9ab0-dfb2e2cec643 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 10 17:37:12.892992 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 9/16] 10.222.0.60 () {54 vars in 930 bytes} [Tue May 10 17:37:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:37:12.962033 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-2469c52a-dbfb-4a20-b304-bab9450eb9b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds4G", "id": "d4", "disk": 20, "ram": 4096}} {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:12.982170 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-2469c52a-dbfb-4a20-b304-bab9450eb9b1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082330 May 10 17:37:12.983242 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 8/17] 10.222.0.60 () {64 vars in 1282 bytes} [Tue May 10 17:37:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:37:12.995631 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-72f96258-3b58-480e-ac41-04f0badc0cbf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:13.020057 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-72f96258-3b58-480e-ac41-04f0badc0cbf admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028864 May 10 17:37:13.020669 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 10/18] 10.222.0.60 () {64 vars in 1335 bytes} [Tue May 10 17:37:12 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:37:15.367896 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-2469c52a-dbfb-4a20-b304-bab9450eb9b1 admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:15.368926 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-2469c52a-dbfb-4a20-b304-bab9450eb9b1 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001583 May 10 17:37:15.369332 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 9/19] 10.222.0.60 () {54 vars in 930 bytes} [Tue May 10 17:37:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:37:15.433303 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-3bc7d683-6ec2-45f7-bac6-ca3be9c2e8bf admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:15.459046 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-3bc7d683-6ec2-45f7-bac6-ca3be9c2e8bf admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083450 May 10 17:37:15.459967 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 11/20] 10.222.0.60 () {60 vars in 1291 bytes} [Tue May 10 17:37:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:37:17.880054 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-2469c52a-dbfb-4a20-b304-bab9450eb9b1 admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:17.881172 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-2469c52a-dbfb-4a20-b304-bab9450eb9b1 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 May 10 17:37:17.881562 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 10/21] 10.222.0.60 () {54 vars in 930 bytes} [Tue May 10 17:37:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:37:17.945201 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-5f872e2d-5ae3-4389-9ad8-ee974772b2f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "ram": 512, "vcpus": 1, "swap": 0}} {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:17.964631 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-5f872e2d-5ae3-4389-9ad8-ee974772b2f9 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076444 May 10 17:37:17.965307 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 12/22] 10.222.0.60 () {64 vars in 1282 bytes} [Tue May 10 17:37:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:37:17.977812 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-ef8009c7-80ba-44fd-b262-35a684e792ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:18.001554 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-ef8009c7-80ba-44fd-b262-35a684e792ef admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028094 May 10 17:37:18.002177 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 11/23] 10.222.0.60 () {64 vars in 1332 bytes} [Tue May 10 17:37:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:37:20.383793 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-5f872e2d-5ae3-4389-9ad8-ee974772b2f9 admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:20.384817 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-5f872e2d-5ae3-4389-9ad8-ee974772b2f9 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 May 10 17:37:20.385227 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 13/24] 10.222.0.60 () {54 vars in 930 bytes} [Tue May 10 17:37:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:37:20.458825 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-1980fc99-1968-44f1-8752-4b7a12a740e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "2", "vcpus": 1, "name": "m1.small", "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:20.481850 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-1980fc99-1968-44f1-8752-4b7a12a740e2 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.088453 May 10 17:37:20.482590 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 12/25] 10.222.0.60 () {64 vars in 1282 bytes} [Tue May 10 17:37:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:37:20.496456 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-11a6659f-b52e-47bd-9e8d-2b62d12bee64 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:20.519228 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-11a6659f-b52e-47bd-9e8d-2b62d12bee64 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026464 May 10 17:37:20.519854 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 14/26] 10.222.0.60 () {64 vars in 1332 bytes} [Tue May 10 17:37:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:37:22.861045 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-1980fc99-1968-44f1-8752-4b7a12a740e2 admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:22.862072 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-1980fc99-1968-44f1-8752-4b7a12a740e2 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 10 17:37:22.862481 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 13/27] 10.222.0.60 () {54 vars in 930 bytes} [Tue May 10 17:37:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:37:22.921542 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-8a56dd15-d072-4696-bef8-1fd46c4c9149 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "id": "3", "swap": 0, "disk": 40, "ram": 4096, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:22.938974 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-8a56dd15-d072-4696-bef8-1fd46c4c9149 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070514 May 10 17:37:22.939550 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 15/28] 10.222.0.60 () {64 vars in 1282 bytes} [Tue May 10 17:37:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:37:22.952272 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-49da229a-5289-40eb-bce2-68fcc08e58cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:22.974631 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-49da229a-5289-40eb-bce2-68fcc08e58cf admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026085 May 10 17:37:22.975275 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 14/29] 10.222.0.60 () {64 vars in 1332 bytes} [Tue May 10 17:37:22 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:37:25.257188 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-8a56dd15-d072-4696-bef8-1fd46c4c9149 admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:25.258203 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-8a56dd15-d072-4696-bef8-1fd46c4c9149 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002442 May 10 17:37:25.258879 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 16/30] 10.222.0.60 () {54 vars in 930 bytes} [Tue May 10 17:37:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:37:25.342689 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-2e858dc2-78f0-4254-94fc-87dcba60eff3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "name": "m1.large", "vcpus": 4, "disk": 80, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:25.361911 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-2e858dc2-78f0-4254-94fc-87dcba60eff3 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.096893 May 10 17:37:25.362694 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 15/31] 10.222.0.60 () {64 vars in 1282 bytes} [Tue May 10 17:37:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:37:25.375434 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-64a67125-8b42-410a-a653-08c4a6d1039b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:25.402889 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-64a67125-8b42-410a-a653-08c4a6d1039b admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031115 May 10 17:37:25.403822 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 17/32] 10.222.0.60 () {64 vars in 1332 bytes} [Tue May 10 17:37:25 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:37:27.967835 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-2e858dc2-78f0-4254-94fc-87dcba60eff3 admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:27.969850 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-2e858dc2-78f0-4254-94fc-87dcba60eff3 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002548 May 10 17:37:27.970621 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 16/33] 10.222.0.60 () {54 vars in 930 bytes} [Tue May 10 17:37:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:37:28.046988 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-cf881165-9526-4f43-b6f0-df6bc075aafd admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true, "disk": 160, "name": "m1.xlarge", "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:28.068338 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-cf881165-9526-4f43-b6f0-df6bc075aafd admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.090559 May 10 17:37:28.069856 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 18/34] 10.222.0.60 () {64 vars in 1282 bytes} [Tue May 10 17:37:27 2022] POST /compute/v2.1/flavors => generated 408 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:37:28.083953 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-75de8738-c094-4381-9f51-6c145561f7a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:28.109535 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-75de8738-c094-4381-9f51-6c145561f7a9 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029588 May 10 17:37:28.110360 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 17/35] 10.222.0.60 () {64 vars in 1332 bytes} [Tue May 10 17:37:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:37:52.087179 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-cf881165-9526-4f43-b6f0-df6bc075aafd admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:52.088264 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-cf881165-9526-4f43-b6f0-df6bc075aafd admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 10 17:37:52.088608 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 19/36] 10.222.0.60 () {54 vars in 930 bytes} [Tue May 10 17:37:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:37:52.148221 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-3cdcfa47-f612-406d-90fc-9d66118b8129 admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:52.166143 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-3cdcfa47-f612-406d-90fc-9d66118b8129 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071536 May 10 17:37:52.166681 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 18/37] 10.222.0.60 () {60 vars in 1291 bytes} [Tue May 10 17:37:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:37:53.195926 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-cf881165-9526-4f43-b6f0-df6bc075aafd admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:53.196934 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-cf881165-9526-4f43-b6f0-df6bc075aafd admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 May 10 17:37:53.197334 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 20/38] 10.222.0.60 () {56 vars in 1074 bytes} [Tue May 10 17:37:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:37:53.417028 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-b0ba3874-2e6a-47fa-ae5e-3c9c7113866a admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:53.423313 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.wsgi [None req-b0ba3874-2e6a-47fa-ae5e-3c9c7113866a admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-b0ba3874-2e6a-47fa-ae5e-3c9c7113866a admin admin] Request method failure captured: May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Accept: application/json May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Accept-Encoding: gzip, deflate May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Connection: keep-alive May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Content-Length: 0 May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Host: 10.222.0.60 May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Openstack-Api-Version: compute 2.90 May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Openstack-System-Scope: None May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: User-Agent: python-novaclient May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Auth-Token: gAAAAABieqLxdPJogmEr7pcCG2LupsJ8DD_iqO2GGrPk9vJrd8ctWgu1uZVXOeNIms663Jsz8-NssnHHWcH_62JtnxIFF2CbiSeKmHDzZd4t2MADUpvf-BqUR1O0m1K8rWZUyPnbOiF-PqVlmqWmHIS_WJK3A1HrWSTj-yxPpJ1zDxM1hHxuZWU May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Domain-Id: None May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Domain-Name: None May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Identity-Status: Confirmed May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Is-Admin-Project: True May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Openstack-Nova-Api-Version: 2.90 May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Project-Domain-Id: default May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Project-Domain-Name: Default May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Project-Id: 05b43e5ee8d94e7eabaa576aaa97efc1 May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Project-Name: admin May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Role: member,admin,reader May 10 17:37:53.426668 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Roles: member,admin,reader May 10 17:37:53.428257 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05b43e5ee8d94e7eabaa576aaa97efc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/05b43e5ee8d94e7eabaa576aaa97efc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_05b43e5ee8d94e7eabaa576aaa97efc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05b43e5ee8d94e7eabaa576aaa97efc1"}]}] May 10 17:37:53.428257 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Tenant: admin May 10 17:37:53.428257 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Tenant-Id: 05b43e5ee8d94e7eabaa576aaa97efc1 May 10 17:37:53.428257 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Tenant-Name: admin May 10 17:37:53.428257 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-User: admin May 10 17:37:53.428257 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-User-Domain-Id: default May 10 17:37:53.428257 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-User-Domain-Name: Default May 10 17:37:53.428257 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-User-Id: cf223ad1bb814591a9871f0dc159ef4b May 10 17:37:53.428257 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-User-Name: admin May 10 17:37:53.428257 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: method: > May 10 17:37:53.428257 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: exception: Flavor 42 could not be found. May 10 17:37:53.428257 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: action_args: {'id': '42'} May 10 17:37:53.428257 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:37:53.428257 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:37:53.429342 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 17:37:53.429342 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 17:37:53.429342 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 17:37:53.429342 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 17:37:53.429342 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 17:37:53.429342 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 17:37:53.429342 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 17:37:53.429342 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 17:37:53.429342 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 17:37:53.429342 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:37:53.429342 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 17:37:53.429342 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 17:37:53.429342 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 17:37:53.429342 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi May 10 17:37:53.429342 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:37:53.429342 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi May 10 17:37:53.429342 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:37:53.429342 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:37:53.429342 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:37:53.430934 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:37:53.430934 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:37:53.430934 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:37:53.430934 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:37:53.430934 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 17:37:53.430934 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 17:37:53.430934 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 17:37:53.430934 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi May 10 17:37:53.430934 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:37:53.430934 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi May 10 17:37:53.430934 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:37:53.430934 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:37:53.430934 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:37:53.430934 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:37:53.430934 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:37:53.430934 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 17:37:53.430934 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi May 10 17:37:53.430934 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-b0ba3874-2e6a-47fa-ae5e-3c9c7113866a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:37:53.432208 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-b0ba3874-2e6a-47fa-ae5e-3c9c7113866a admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.066447 May 10 17:37:53.432208 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 19/39] 10.222.0.60 () {60 vars in 1190 bytes} [Tue May 10 17:37:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 17:37:53.438576 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-2235cca4-c10b-4c64-98d2-ff12aca21418 admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:53.461909 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-2235cca4-c10b-4c64-98d2-ff12aca21418 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026931 May 10 17:37:53.462486 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 21/40] 10.222.0.60 () {60 vars in 1210 bytes} [Tue May 10 17:37:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:37:53.481063 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-6878ac1b-7466-48a1-b808-aa164c3cbccf admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:53.502367 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-6878ac1b-7466-48a1-b808-aa164c3cbccf admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025015 May 10 17:37:53.502936 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 20/41] 10.222.0.60 () {60 vars in 1210 bytes} [Tue May 10 17:37:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:37:53.512431 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-2469f9d3-f6f7-4b3f-b547-b17686e557c1 admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:53.518193 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.wsgi [None req-2469f9d3-f6f7-4b3f-b547-b17686e557c1 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-2469f9d3-f6f7-4b3f-b547-b17686e557c1 admin admin] Request method failure captured: May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Accept: application/json May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Accept-Encoding: gzip, deflate May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Connection: keep-alive May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Content-Length: 0 May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Host: 10.222.0.60 May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Openstack-Api-Version: compute 2.90 May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Openstack-System-Scope: None May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: User-Agent: python-novaclient May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Auth-Token: gAAAAABieqLxdPJogmEr7pcCG2LupsJ8DD_iqO2GGrPk9vJrd8ctWgu1uZVXOeNIms663Jsz8-NssnHHWcH_62JtnxIFF2CbiSeKmHDzZd4t2MADUpvf-BqUR1O0m1K8rWZUyPnbOiF-PqVlmqWmHIS_WJK3A1HrWSTj-yxPpJ1zDxM1hHxuZWU May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Domain-Id: None May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Domain-Name: None May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Identity-Status: Confirmed May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Is-Admin-Project: True May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Openstack-Nova-Api-Version: 2.90 May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Project-Domain-Id: default May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Project-Domain-Name: Default May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Project-Id: 05b43e5ee8d94e7eabaa576aaa97efc1 May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Project-Name: admin May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Role: member,admin,reader May 10 17:37:53.522679 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Roles: member,admin,reader May 10 17:37:53.524195 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05b43e5ee8d94e7eabaa576aaa97efc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/05b43e5ee8d94e7eabaa576aaa97efc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_05b43e5ee8d94e7eabaa576aaa97efc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05b43e5ee8d94e7eabaa576aaa97efc1"}]}] May 10 17:37:53.524195 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Tenant: admin May 10 17:37:53.524195 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Tenant-Id: 05b43e5ee8d94e7eabaa576aaa97efc1 May 10 17:37:53.524195 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Tenant-Name: admin May 10 17:37:53.524195 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-User: admin May 10 17:37:53.524195 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-User-Domain-Id: default May 10 17:37:53.524195 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-User-Domain-Name: Default May 10 17:37:53.524195 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-User-Id: cf223ad1bb814591a9871f0dc159ef4b May 10 17:37:53.524195 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-User-Name: admin May 10 17:37:53.524195 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: method: > May 10 17:37:53.524195 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: exception: Flavor 42 could not be found. May 10 17:37:53.524195 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: action_args: {'id': '42'} May 10 17:37:53.524195 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:37:53.524195 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:37:53.525451 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 17:37:53.525451 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 17:37:53.525451 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 17:37:53.525451 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 17:37:53.525451 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 17:37:53.525451 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 17:37:53.525451 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 17:37:53.525451 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 17:37:53.525451 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 17:37:53.525451 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:37:53.525451 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 17:37:53.525451 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 17:37:53.525451 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 10 17:37:53.525451 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi May 10 17:37:53.525451 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:37:53.525451 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi May 10 17:37:53.525451 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:37:53.525451 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:37:53.525451 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:37:53.527120 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:37:53.527120 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:37:53.527120 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:37:53.527120 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:37:53.527120 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 17:37:53.527120 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 17:37:53.527120 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 10 17:37:53.527120 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi May 10 17:37:53.527120 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:37:53.527120 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi May 10 17:37:53.527120 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:37:53.527120 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:37:53.527120 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:37:53.527120 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:37:53.527120 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:37:53.527120 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 10 17:37:53.527120 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi May 10 17:37:53.527120 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-2469f9d3-f6f7-4b3f-b547-b17686e557c1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109413) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:37:53.528584 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-2469f9d3-f6f7-4b3f-b547-b17686e557c1 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015345 May 10 17:37:53.528584 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 22/42] 10.222.0.60 () {60 vars in 1190 bytes} [Tue May 10 17:37:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 17:37:54.431053 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-6878ac1b-7466-48a1-b808-aa164c3cbccf admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:54.432178 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-6878ac1b-7466-48a1-b808-aa164c3cbccf admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 May 10 17:37:54.432579 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 21/43] 10.222.0.60 () {56 vars in 1074 bytes} [Tue May 10 17:37:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:37:54.634668 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-0a1bf461-a237-4ac6-8373-337a083b2a13 admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:54.640116 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.wsgi [None req-0a1bf461-a237-4ac6-8373-337a083b2a13 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-0a1bf461-a237-4ac6-8373-337a083b2a13 admin admin] Request method failure captured: May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Accept: application/json May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Accept-Encoding: gzip, deflate May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Connection: keep-alive May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Content-Length: 0 May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Host: 10.222.0.60 May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Openstack-Api-Version: compute 2.90 May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Openstack-System-Scope: None May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: User-Agent: python-novaclient May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Auth-Token: gAAAAABieqLy6YF0zZIh9VxOYNFLscOB7DcxxGwbSmO5D5fqaiJRgnZ0LFhmUVgTRkkhtNT0ZEJ2DqHZugCgmTqQeCwpWGikj4_dDTckudzzGaywpJpz0GpXylvzqhM9XQCyXtmijkywWy2lDUVdp9dTJCZ2puvdCbl5XAJOY5TZI59qZt5zrfQ May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Domain-Id: None May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Domain-Name: None May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Identity-Status: Confirmed May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Is-Admin-Project: True May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Openstack-Nova-Api-Version: 2.90 May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Project-Domain-Id: default May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Project-Domain-Name: Default May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Project-Id: 05b43e5ee8d94e7eabaa576aaa97efc1 May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Project-Name: admin May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Role: member,admin,reader May 10 17:37:54.641563 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Roles: member,admin,reader May 10 17:37:54.643055 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05b43e5ee8d94e7eabaa576aaa97efc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/05b43e5ee8d94e7eabaa576aaa97efc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_05b43e5ee8d94e7eabaa576aaa97efc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05b43e5ee8d94e7eabaa576aaa97efc1"}]}] May 10 17:37:54.643055 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Tenant: admin May 10 17:37:54.643055 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Tenant-Id: 05b43e5ee8d94e7eabaa576aaa97efc1 May 10 17:37:54.643055 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Tenant-Name: admin May 10 17:37:54.643055 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-User: admin May 10 17:37:54.643055 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-User-Domain-Id: default May 10 17:37:54.643055 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-User-Domain-Name: Default May 10 17:37:54.643055 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-User-Id: cf223ad1bb814591a9871f0dc159ef4b May 10 17:37:54.643055 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-User-Name: admin May 10 17:37:54.643055 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: method: > May 10 17:37:54.643055 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: exception: Flavor 84 could not be found. May 10 17:37:54.643055 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: action_args: {'id': '84'} May 10 17:37:54.643055 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:37:54.643055 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:37:54.644211 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 17:37:54.644211 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 17:37:54.644211 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 17:37:54.644211 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 17:37:54.644211 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 17:37:54.644211 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 17:37:54.644211 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 17:37:54.644211 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 17:37:54.644211 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 17:37:54.644211 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:37:54.644211 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 17:37:54.644211 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 17:37:54.644211 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 17:37:54.644211 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi May 10 17:37:54.644211 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:37:54.644211 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi May 10 17:37:54.644211 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:37:54.644211 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:37:54.644211 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:37:54.645571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:37:54.645571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:37:54.645571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:37:54.645571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:37:54.645571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 17:37:54.645571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 17:37:54.645571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 17:37:54.645571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi May 10 17:37:54.645571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:37:54.645571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi May 10 17:37:54.645571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:37:54.645571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:37:54.645571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:37:54.645571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:37:54.645571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:37:54.645571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 17:37:54.645571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi May 10 17:37:54.645571 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-0a1bf461-a237-4ac6-8373-337a083b2a13 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109413) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:37:54.647382 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-0a1bf461-a237-4ac6-8373-337a083b2a13 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065440 May 10 17:37:54.647382 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 23/44] 10.222.0.60 () {60 vars in 1190 bytes} [Tue May 10 17:37:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 17:37:54.653536 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-fc6f15ad-2ed6-4d79-bf81-8465a736548e admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:54.668273 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-fc6f15ad-2ed6-4d79-bf81-8465a736548e admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018326 May 10 17:37:54.668832 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 22/45] 10.222.0.60 () {60 vars in 1210 bytes} [Tue May 10 17:37:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:37:54.679231 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-c3891c6e-4172-485c-b1c1-8734d8aed384 admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:54.693322 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-c3891c6e-4172-485c-b1c1-8734d8aed384 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018274 May 10 17:37:54.693884 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 24/46] 10.222.0.60 () {60 vars in 1210 bytes} [Tue May 10 17:37:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:37:54.703315 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-c7c4c4fa-14e4-447e-9060-12b60beb1efc admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:54.709378 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.wsgi [None req-c7c4c4fa-14e4-447e-9060-12b60beb1efc admin admin] HTTP exception thrown: Flavor 84 could not be found. May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-c7c4c4fa-14e4-447e-9060-12b60beb1efc admin admin] Request method failure captured: May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Accept: application/json May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Accept-Encoding: gzip, deflate May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Connection: keep-alive May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Content-Length: 0 May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Host: 10.222.0.60 May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Openstack-Api-Version: compute 2.90 May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Openstack-System-Scope: None May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: User-Agent: python-novaclient May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Auth-Token: gAAAAABieqLy6YF0zZIh9VxOYNFLscOB7DcxxGwbSmO5D5fqaiJRgnZ0LFhmUVgTRkkhtNT0ZEJ2DqHZugCgmTqQeCwpWGikj4_dDTckudzzGaywpJpz0GpXylvzqhM9XQCyXtmijkywWy2lDUVdp9dTJCZ2puvdCbl5XAJOY5TZI59qZt5zrfQ May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Domain-Id: None May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Domain-Name: None May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Identity-Status: Confirmed May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Is-Admin-Project: True May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Openstack-Nova-Api-Version: 2.90 May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Project-Domain-Id: default May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Project-Domain-Name: Default May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Project-Id: 05b43e5ee8d94e7eabaa576aaa97efc1 May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Project-Name: admin May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Role: member,admin,reader May 10 17:37:54.711040 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Roles: member,admin,reader May 10 17:37:54.712712 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05b43e5ee8d94e7eabaa576aaa97efc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/05b43e5ee8d94e7eabaa576aaa97efc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_05b43e5ee8d94e7eabaa576aaa97efc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05b43e5ee8d94e7eabaa576aaa97efc1"}]}] May 10 17:37:54.712712 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Tenant: admin May 10 17:37:54.712712 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Tenant-Id: 05b43e5ee8d94e7eabaa576aaa97efc1 May 10 17:37:54.712712 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Tenant-Name: admin May 10 17:37:54.712712 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-User: admin May 10 17:37:54.712712 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-User-Domain-Id: default May 10 17:37:54.712712 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-User-Domain-Name: Default May 10 17:37:54.712712 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-User-Id: cf223ad1bb814591a9871f0dc159ef4b May 10 17:37:54.712712 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-User-Name: admin May 10 17:37:54.712712 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: method: > May 10 17:37:54.712712 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: exception: Flavor 84 could not be found. May 10 17:37:54.712712 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: action_args: {'id': '84'} May 10 17:37:54.712712 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:37:54.712712 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:37:54.714101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 17:37:54.714101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 17:37:54.714101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 17:37:54.714101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 17:37:54.714101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 17:37:54.714101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 17:37:54.714101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 17:37:54.714101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 17:37:54.714101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 17:37:54.714101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:37:54.714101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 17:37:54.714101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 17:37:54.714101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 10 17:37:54.714101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi May 10 17:37:54.714101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:37:54.714101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi May 10 17:37:54.714101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:37:54.714101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:37:54.714101 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:37:54.715879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:37:54.715879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:37:54.715879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:37:54.715879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:37:54.715879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 17:37:54.715879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 17:37:54.715879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 10 17:37:54.715879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi May 10 17:37:54.715879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:37:54.715879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi May 10 17:37:54.715879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:37:54.715879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:37:54.715879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:37:54.715879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:37:54.715879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:37:54.715879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 10 17:37:54.715879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi May 10 17:37:54.715879 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-c7c4c4fa-14e4-447e-9060-12b60beb1efc admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:37:54.717214 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-c7c4c4fa-14e4-447e-9060-12b60beb1efc admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012727 May 10 17:37:54.717214 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 23/47] 10.222.0.60 () {60 vars in 1190 bytes} [Tue May 10 17:37:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 17:37:55.640493 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-c3891c6e-4172-485c-b1c1-8734d8aed384 admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:55.641494 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-c3891c6e-4172-485c-b1c1-8734d8aed384 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 10 17:37:55.641888 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 25/48] 10.222.0.60 () {56 vars in 1074 bytes} [Tue May 10 17:37:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:37:55.832749 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-0b0f5866-6c4d-4fa3-94d8-8b68268d408b admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:55.838930 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.wsgi [None req-0b0f5866-6c4d-4fa3-94d8-8b68268d408b admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-0b0f5866-6c4d-4fa3-94d8-8b68268d408b admin admin] Request method failure captured: May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Accept: application/json May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Accept-Encoding: gzip, deflate May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Connection: keep-alive May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Content-Length: 0 May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Host: 10.222.0.60 May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Openstack-Api-Version: compute 2.90 May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Openstack-System-Scope: None May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: User-Agent: python-novaclient May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Auth-Token: gAAAAABieqLzKWuu3Ck638cjIk1SQd-wUx4QfqjAUOyBIFnu4J5Jj-C3BBvE5T8643X4hVa1q0afVG4dp90aTzeHqU8tSycRfLRzw3d-WkLnb2-PFho_YPjN2y86ZgSjz-iKLVVZqGlRgmwl5uuS_4qez5B5YlbtxsuGcXliO63e5mZHnZFo08I May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Domain-Id: None May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Domain-Name: None May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Identity-Status: Confirmed May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Is-Admin-Project: True May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Openstack-Nova-Api-Version: 2.90 May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Project-Domain-Id: default May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Project-Domain-Name: Default May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Project-Id: 05b43e5ee8d94e7eabaa576aaa97efc1 May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Project-Name: admin May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Role: member,admin,reader May 10 17:37:55.840488 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Roles: member,admin,reader May 10 17:37:55.842100 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05b43e5ee8d94e7eabaa576aaa97efc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/05b43e5ee8d94e7eabaa576aaa97efc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_05b43e5ee8d94e7eabaa576aaa97efc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05b43e5ee8d94e7eabaa576aaa97efc1"}]}] May 10 17:37:55.842100 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Tenant: admin May 10 17:37:55.842100 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Tenant-Id: 05b43e5ee8d94e7eabaa576aaa97efc1 May 10 17:37:55.842100 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-Tenant-Name: admin May 10 17:37:55.842100 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-User: admin May 10 17:37:55.842100 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-User-Domain-Id: default May 10 17:37:55.842100 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-User-Domain-Name: Default May 10 17:37:55.842100 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-User-Id: cf223ad1bb814591a9871f0dc159ef4b May 10 17:37:55.842100 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: X-User-Name: admin May 10 17:37:55.842100 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: method: > May 10 17:37:55.842100 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: exception: Flavor 451 could not be found. May 10 17:37:55.842100 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: action_args: {'id': '451'} May 10 17:37:55.842100 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:37:55.842100 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:37:55.843147 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 17:37:55.843147 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 17:37:55.843147 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 17:37:55.843147 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 17:37:55.843147 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 17:37:55.843147 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 17:37:55.843147 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 17:37:55.843147 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 17:37:55.843147 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 17:37:55.843147 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:37:55.843147 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 17:37:55.843147 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 17:37:55.843147 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 17:37:55.843147 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi May 10 17:37:55.843147 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:37:55.843147 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi May 10 17:37:55.843147 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:37:55.843147 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:37:55.843147 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:37:55.844529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:37:55.844529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:37:55.844529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:37:55.844529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:37:55.844529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 17:37:55.844529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 17:37:55.844529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 17:37:55.844529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi May 10 17:37:55.844529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:37:55.844529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi May 10 17:37:55.844529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:37:55.844529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:37:55.844529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:37:55.844529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:37:55.844529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:37:55.844529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 17:37:55.844529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: ERROR nova.api.openstack.wsgi May 10 17:37:55.844529 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-0b0f5866-6c4d-4fa3-94d8-8b68268d408b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:37:55.845751 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-0b0f5866-6c4d-4fa3-94d8-8b68268d408b admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.063666 May 10 17:37:55.845751 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 24/49] 10.222.0.60 () {60 vars in 1193 bytes} [Tue May 10 17:37:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 17:37:55.852228 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-b98f2178-4b6c-443a-ab21-3d0f8323b219 admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:55.872943 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-b98f2178-4b6c-443a-ab21-3d0f8323b219 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024780 May 10 17:37:55.873517 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 26/50] 10.222.0.60 () {60 vars in 1210 bytes} [Tue May 10 17:37:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:37:55.887664 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-a1aa792b-bff8-44e6-8d09-0abee7c10abe admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:55.902116 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-a1aa792b-bff8-44e6-8d09-0abee7c10abe admin admin] 10.222.0.60 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018353 May 10 17:37:55.902680 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 25/51] 10.222.0.60 () {60 vars in 1210 bytes} [Tue May 10 17:37:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:37:55.913482 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-ac0261c4-a77a-4af9-b3d0-41df96929396 admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:55.918856 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.wsgi [None req-ac0261c4-a77a-4af9-b3d0-41df96929396 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-ac0261c4-a77a-4af9-b3d0-41df96929396 admin admin] Request method failure captured: May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Accept: application/json May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Accept-Encoding: gzip, deflate May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Connection: keep-alive May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Content-Length: 0 May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Host: 10.222.0.60 May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Openstack-Api-Version: compute 2.90 May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Openstack-System-Scope: None May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: User-Agent: python-novaclient May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Auth-Token: gAAAAABieqLzKWuu3Ck638cjIk1SQd-wUx4QfqjAUOyBIFnu4J5Jj-C3BBvE5T8643X4hVa1q0afVG4dp90aTzeHqU8tSycRfLRzw3d-WkLnb2-PFho_YPjN2y86ZgSjz-iKLVVZqGlRgmwl5uuS_4qez5B5YlbtxsuGcXliO63e5mZHnZFo08I May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Domain-Id: None May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Domain-Name: None May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Identity-Status: Confirmed May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Is-Admin-Project: True May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Openstack-Nova-Api-Version: 2.90 May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Project-Domain-Id: default May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Project-Domain-Name: Default May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Project-Id: 05b43e5ee8d94e7eabaa576aaa97efc1 May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Project-Name: admin May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Role: member,admin,reader May 10 17:37:55.920529 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Roles: member,admin,reader May 10 17:37:55.922058 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05b43e5ee8d94e7eabaa576aaa97efc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/05b43e5ee8d94e7eabaa576aaa97efc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_05b43e5ee8d94e7eabaa576aaa97efc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/05b43e5ee8d94e7eabaa576aaa97efc1"}]}] May 10 17:37:55.922058 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Tenant: admin May 10 17:37:55.922058 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Tenant-Id: 05b43e5ee8d94e7eabaa576aaa97efc1 May 10 17:37:55.922058 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-Tenant-Name: admin May 10 17:37:55.922058 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-User: admin May 10 17:37:55.922058 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-User-Domain-Id: default May 10 17:37:55.922058 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-User-Domain-Name: Default May 10 17:37:55.922058 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-User-Id: cf223ad1bb814591a9871f0dc159ef4b May 10 17:37:55.922058 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: X-User-Name: admin May 10 17:37:55.922058 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: method: > May 10 17:37:55.922058 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: exception: Flavor 451 could not be found. May 10 17:37:55.922058 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: action_args: {'id': '451'} May 10 17:37:55.922058 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:37:55.922058 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:37:55.923025 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 10 17:37:55.923025 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 10 17:37:55.923025 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 10 17:37:55.923025 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 10 17:37:55.923025 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 17:37:55.923025 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 17:37:55.923025 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 10 17:37:55.923025 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 10 17:37:55.923025 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 10 17:37:55.923025 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:37:55.923025 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 10 17:37:55.923025 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 10 17:37:55.923025 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 10 17:37:55.923025 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi May 10 17:37:55.923025 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:37:55.923025 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi May 10 17:37:55.923025 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:37:55.923025 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:37:55.923025 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:37:55.924444 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:37:55.924444 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:37:55.924444 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:37:55.924444 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:37:55.924444 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 10 17:37:55.924444 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 10 17:37:55.924444 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 10 17:37:55.924444 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi May 10 17:37:55.924444 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:37:55.924444 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi May 10 17:37:55.924444 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:37:55.924444 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:37:55.924444 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:37:55.924444 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:37:55.924444 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:37:55.924444 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 10 17:37:55.924444 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: ERROR nova.api.openstack.wsgi May 10 17:37:55.924444 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-ac0261c4-a77a-4af9-b3d0-41df96929396 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109413) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:37:55.925645 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-ac0261c4-a77a-4af9-b3d0-41df96929396 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013211 May 10 17:37:55.925645 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 27/52] 10.222.0.60 () {60 vars in 1193 bytes} [Tue May 10 17:37:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 10 17:37:56.841938 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-a1aa792b-bff8-44e6-8d09-0abee7c10abe admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:56.842952 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-a1aa792b-bff8-44e6-8d09-0abee7c10abe admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 10 17:37:56.843352 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 26/53] 10.222.0.60 () {56 vars in 1074 bytes} [Tue May 10 17:37:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:37:57.050803 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-9e27a3e5-d02e-402a-8971-049c3f8cf8e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:57.068999 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-9e27a3e5-d02e-402a-8971-049c3f8cf8e2 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.072659 May 10 17:37:57.069532 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 28/54] 10.222.0.60 () {64 vars in 1235 bytes} [Tue May 10 17:37:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:37:57.968388 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-a1aa792b-bff8-44e6-8d09-0abee7c10abe admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:57.969496 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-a1aa792b-bff8-44e6-8d09-0abee7c10abe admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 May 10 17:37:57.969865 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 27/55] 10.222.0.60 () {56 vars in 1074 bytes} [Tue May 10 17:37:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:37:58.159967 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-ffd521f3-b803-445c-8aac-a102877c0c3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:58.177092 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-ffd521f3-b803-445c-8aac-a102877c0c3d admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069029 May 10 17:37:58.177565 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 29/56] 10.222.0.60 () {64 vars in 1235 bytes} [Tue May 10 17:37:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:37:59.066234 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-a1aa792b-bff8-44e6-8d09-0abee7c10abe admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:37:59.067237 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-a1aa792b-bff8-44e6-8d09-0abee7c10abe admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 10 17:37:59.068354 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 28/57] 10.222.0.60 () {56 vars in 1074 bytes} [Tue May 10 17:37:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:37:59.255387 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-3d498c1c-bb41-48a0-a207-d580ff0dcef1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:37:59.272800 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-3d498c1c-bb41-48a0-a207-d580ff0dcef1 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069435 May 10 17:37:59.273347 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 30/58] 10.222.0.60 () {64 vars in 1235 bytes} [Tue May 10 17:37:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:38:00.202162 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-a1aa792b-bff8-44e6-8d09-0abee7c10abe admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:00.203158 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-a1aa792b-bff8-44e6-8d09-0abee7c10abe admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 10 17:38:00.203582 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 29/59] 10.222.0.60 () {56 vars in 1074 bytes} [Tue May 10 17:38:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:38:00.399350 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-3762c8f2-b4cb-491a-a967-2a06ea4b9da8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:38:00.416830 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-3762c8f2-b4cb-491a-a967-2a06ea4b9da8 admin admin] 10.222.0.60 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070286 May 10 17:38:00.417372 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 31/60] 10.222.0.60 () {64 vars in 1235 bytes} [Tue May 10 17:38:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:38:01.308840 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-a1aa792b-bff8-44e6-8d09-0abee7c10abe admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:01.309854 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-a1aa792b-bff8-44e6-8d09-0abee7c10abe admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 May 10 17:38:01.310266 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 30/61] 10.222.0.60 () {56 vars in 1074 bytes} [Tue May 10 17:38:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:38:01.503938 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-7f58a7d8-fc50-4cff-9c34-39c5b3c7f751 admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:38:01.523696 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-7f58a7d8-fc50-4cff-9c34-39c5b3c7f751 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073393 May 10 17:38:01.524239 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 32/62] 10.222.0.60 () {60 vars in 1202 bytes} [Tue May 10 17:38:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:39:04.407647 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-a1aa792b-bff8-44e6-8d09-0abee7c10abe admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:39:04.408661 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-a1aa792b-bff8-44e6-8d09-0abee7c10abe admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 May 10 17:39:04.409060 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 31/63] 10.222.0.60 () {54 vars in 930 bytes} [Tue May 10 17:39:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:39:04.468051 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-f1c315ed-ca9e-42ad-b564-5e821a6ae964 admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:39:04.488958 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-f1c315ed-ca9e-42ad-b564-5e821a6ae964 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073452 May 10 17:39:04.489514 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 33/64] 10.222.0.60 () {60 vars in 1291 bytes} [Tue May 10 17:39:04 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:39:04.512209 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-613d9536-b17b-4132-b480-e3482565acdd admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:39:04.520694 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-613d9536-b17b-4132-b480-e3482565acdd admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012685 May 10 17:39:04.521604 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 32/65] 10.222.0.60 () {60 vars in 1282 bytes} [Tue May 10 17:39:04 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:39:04.532803 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-7585a08a-3024-493f-b8eb-06f0f0d9c83f admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:39:04.540356 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-7585a08a-3024-493f-b8eb-06f0f0d9c83f admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011141 May 10 17:39:04.540894 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 34/66] 10.222.0.60 () {60 vars in 1285 bytes} [Tue May 10 17:39:04 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:39:04.552839 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-72381f04-1b57-4fb1-bfad-82fafbe95bc5 admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:39:04.560448 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-72381f04-1b57-4fb1-bfad-82fafbe95bc5 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012001 May 10 17:39:04.560966 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 33/67] 10.222.0.60 () {60 vars in 1285 bytes} [Tue May 10 17:39:04 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:39:04.573814 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-097393b1-19bf-441c-87eb-c1f75c2f5e79 admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:39:04.581401 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-097393b1-19bf-441c-87eb-c1f75c2f5e79 admin admin] 10.222.0.60 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011599 May 10 17:39:04.582032 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 35/68] 10.222.0.60 () {60 vars in 1282 bytes} [Tue May 10 17:39:04 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:42:25.534165 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-72381f04-1b57-4fb1-bfad-82fafbe95bc5 admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:42:25.535286 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-72381f04-1b57-4fb1-bfad-82fafbe95bc5 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 May 10 17:42:25.535787 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 34/69] 10.222.0.60 () {56 vars in 1074 bytes} [Tue May 10 17:42:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:42:25.828479 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-88b6e0ff-817f-43af-8fdc-6a7446ce9d15 admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:42:25.829832 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:42:25.829832 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: warnings.warn(msg) May 10 17:42:25.831209 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-88b6e0ff-817f-43af-8fdc-6a7446ce9d15 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:42:25.831919 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-88b6e0ff-817f-43af-8fdc-6a7446ce9d15 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:42:25.832877 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-88b6e0ff-817f-43af-8fdc-6a7446ce9d15 admin admin] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:42:25.833375 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-88b6e0ff-817f-43af-8fdc-6a7446ce9d15 admin admin] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:42:25.871466 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-88b6e0ff-817f-43af-8fdc-6a7446ce9d15 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.172734 May 10 17:42:25.872052 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 36/70] 10.222.0.60 () {60 vars in 1193 bytes} [Tue May 10 17:42:25 2022] GET /compute/v2.1/os-services => generated 791 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:42:26.920968 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-72381f04-1b57-4fb1-bfad-82fafbe95bc5 admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:42:26.922398 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-72381f04-1b57-4fb1-bfad-82fafbe95bc5 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 May 10 17:42:26.922815 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 35/71] 10.222.0.60 () {56 vars in 1074 bytes} [Tue May 10 17:42:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:42:27.130393 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-1a578a12-c9c1-409e-845f-698066a98684 admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:42:27.131759 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:42:27.131759 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: warnings.warn(msg) May 10 17:42:27.133022 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-1a578a12-c9c1-409e-845f-698066a98684 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:42:27.133480 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-1a578a12-c9c1-409e-845f-698066a98684 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:42:27.134301 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-1a578a12-c9c1-409e-845f-698066a98684 admin admin] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:42:27.134736 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-1a578a12-c9c1-409e-845f-698066a98684 admin admin] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:42:27.155855 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-1a578a12-c9c1-409e-845f-698066a98684 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.085236 May 10 17:42:27.156453 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 37/72] 10.222.0.60 () {60 vars in 1193 bytes} [Tue May 10 17:42:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:42:38.548568 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-72381f04-1b57-4fb1-bfad-82fafbe95bc5 admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:42:38.549581 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-72381f04-1b57-4fb1-bfad-82fafbe95bc5 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 10 17:42:38.549977 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 36/73] 10.222.0.60 () {56 vars in 1074 bytes} [Tue May 10 17:42:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:42:38.746172 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-d27250b6-4c28-4675-8db8-d90006a04743 admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:42:38.748276 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:42:38.748276 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: warnings.warn(msg) May 10 17:42:38.749483 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-d27250b6-4c28-4675-8db8-d90006a04743 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:42:38.749960 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-d27250b6-4c28-4675-8db8-d90006a04743 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:42:38.750753 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-d27250b6-4c28-4675-8db8-d90006a04743 admin admin] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:42:38.751219 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-d27250b6-4c28-4675-8db8-d90006a04743 admin admin] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:42:38.776729 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-d27250b6-4c28-4675-8db8-d90006a04743 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085612 May 10 17:42:38.777205 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 38/74] 10.222.0.60 () {60 vars in 1193 bytes} [Tue May 10 17:42:38 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:42:39.870988 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: DEBUG nova.api.openstack.wsgi [None req-72381f04-1b57-4fb1-bfad-82fafbe95bc5 admin admin] Calling method '>' {{(pid=109412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:42:39.872292 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: INFO nova.api.openstack.requestlog [None req-72381f04-1b57-4fb1-bfad-82fafbe95bc5 admin admin] 10.222.0.60 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001908 May 10 17:42:39.873063 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: [pid: 109412|app: 0|req: 37/75] 10.222.0.60 () {56 vars in 1074 bytes} [Tue May 10 17:42:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:42:40.116674 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG nova.api.openstack.wsgi [None req-57719dc3-ca80-4e17-aa28-a403267ad740 admin admin] Calling method '>' {{(pid=109413) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:42:40.117870 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 10 17:42:40.117870 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: warnings.warn(msg) May 10 17:42:40.119080 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-57719dc3-ca80-4e17-aa28-a403267ad740 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:42:40.119561 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-57719dc3-ca80-4e17-aa28-a403267ad740 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:42:40.120344 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-57719dc3-ca80-4e17-aa28-a403267ad740 admin admin] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:42:40.120771 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: DEBUG oslo_concurrency.lockutils [None req-57719dc3-ca80-4e17-aa28-a403267ad740 admin admin] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109413) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:42:40.145380 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: INFO nova.api.openstack.requestlog [None req-57719dc3-ca80-4e17-aa28-a403267ad740 admin admin] 10.222.0.60 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.103729 May 10 17:42:40.145928 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: [pid: 109413|app: 0|req: 39/76] 10.222.0.60 () {60 vars in 1193 bytes} [Tue May 10 17:42:40 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:43:40.096220 dv-cinder-841302-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 10 17:43:40.097251 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: Tue May 10 17:43:40 2022 - graceful shutdown triggered... May 10 17:43:40.097771 dv-cinder-841302-2-iscsi devstack@n-api.service[109412]: Gracefully killing worker 1 (pid: 109412)... May 10 17:43:40.098182 dv-cinder-841302-2-iscsi devstack@n-api.service[109413]: Gracefully killing worker 2 (pid: 109413)... May 10 17:43:41.098475 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: worker 1 buried after 1 seconds May 10 17:43:41.098475 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: worker 2 buried after 1 seconds May 10 17:43:41.098475 dv-cinder-841302-2-iscsi devstack@n-api.service[109411]: goodbye to uWSGI. May 10 17:43:41.100023 dv-cinder-841302-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 10 17:43:41.100625 dv-cinder-841302-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 10 17:43:41.103411 dv-cinder-841302-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 10 17:43:41.118961 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 10 17:43:41.138738 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 10 17:43:41 2022] *** May 10 17:43:41.138738 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 10 17:43:41.138738 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 10 17:43:41.138738 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: nodename: dv-cinder-841302-2-iscsi May 10 17:43:41.138738 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: machine: x86_64 May 10 17:43:41.138738 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: clock source: unix May 10 17:43:41.138738 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: pcre jit disabled May 10 17:43:41.138738 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: detected number of CPU cores: 4 May 10 17:43:41.138738 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: current working directory: / May 10 17:43:41.138738 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: detected binary path: /usr/bin/uwsgi-core May 10 17:43:41.138738 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: your processes number limit is 47680 May 10 17:43:41.138738 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: your memory page size is 4096 bytes May 10 17:43:41.138738 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: detected max file descriptor number: 2048 May 10 17:43:41.138738 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: lock engine: pthread robust mutexes May 10 17:43:41.139775 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: thunder lock: enabled May 10 17:43:41.139775 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 10 17:43:41.139775 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 10 17:43:41.190085 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: Python main interpreter initialized at 0x56468b8479c0 May 10 17:43:41.190085 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: python threads support enabled May 10 17:43:41.190085 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: your server socket listen backlog is limited to 100 connections May 10 17:43:41.190085 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: your mercy for graceful operations on workers is 90 seconds May 10 17:43:41.190552 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: mapped 403077 bytes (393 KB) for 2 cores May 10 17:43:41.190649 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: *** Operational MODE: preforking *** May 10 17:43:41.190955 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: *** uWSGI is running in multiple interpreter mode *** May 10 17:43:41.190955 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: spawned uWSGI master process (pid: 123737) May 10 17:43:41.191154 dv-cinder-841302-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 10 17:43:41.192053 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: spawned uWSGI worker 1 (pid: 123752, cores: 1) May 10 17:43:41.192053 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: spawned uWSGI worker 2 (pid: 123753, cores: 1) May 10 17:43:41.192281 dv-cinder-841302-2-iscsi devstack@n-api.service[123737]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 10 17:43:42.434893 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 17:43:42.453906 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 10 17:43:43.264793 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:43:43.264793 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: from cryptography.utils import int_from_bytes May 10 17:43:43.265095 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:43:43.265095 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: from cryptography.utils import int_from_bytes May 10 17:43:43.282495 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:43:43.282495 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: from cryptography.utils import int_from_bytes May 10 17:43:43.282920 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 10 17:43:43.282920 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: from cryptography.utils import int_from_bytes May 10 17:43:45.818018 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 17:43:45.818804 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 17:43:45.818917 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 17:43:45.819264 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 17:43:45.819700 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 17:43:45.820474 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.820846 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.821188 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.821524 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.821879 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.822899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.822899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.822899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.823311 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.823740 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.824028 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.824720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841302-2-iscsi {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.824720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.825186 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.825351 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.825692 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.826014 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.826359 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.826687 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.827303 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.829194 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.829194 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.829194 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.829194 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.830662 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.830662 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.830662 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.830662 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.830662 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.832443 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.832443 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841302-2-iscsi {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.832443 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.832443 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.832443 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.834234 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.834234 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.834234 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.834234 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.834234 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.836221 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.836221 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.836221 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.836221 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.836221 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.836221 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.838573 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.838573 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.838573 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.838573 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.838573 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.838573 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.838573 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.838573 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.839792 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.839792 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.839792 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.839792 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.841715 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.841715 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.841715 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.841715 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.841715 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.841715 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.842116 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.842191 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.844508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.844508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.844508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.844508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.844508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.844508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.845071 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.845071 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.845407 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.845617 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.845973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.846851 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.846851 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.847041 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.847255 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.847603 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.847929 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.848264 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.848585 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.848925 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.849246 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.849509 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.849823 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.850144 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.850597 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.850830 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.851109 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.851459 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.851777 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.852095 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.852414 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.852734 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.853055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.853371 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.853688 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.854548 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.854865 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.855184 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.855539 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.855877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.856193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.856511 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.856829 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.857205 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.857472 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.857794 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.858112 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.858445 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.858765 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.859081 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.859434 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.859776 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.860080 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.860412 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.860725 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.861050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.861380 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.861699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.862019 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.862337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.862656 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.862973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.863343 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.863686 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.864050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.864367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.864706 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.865036 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.865359 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.865680 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.866129 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.867112 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.867112 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.867112 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.867698 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.867698 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.868032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.868376 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.868706 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.869210 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.870412 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.870771 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.871275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.871632 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.871972 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.872306 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.872645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.872993 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.873416 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.873749 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.874081 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.874407 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.874737 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.875080 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.875444 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.875772 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.876127 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.876490 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.876856 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.877196 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.877533 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.877858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.878180 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.878503 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.878839 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.879190 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.879536 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.879867 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.880193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.880517 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.880839 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.881273 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.881521 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.881838 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.882163 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.882970 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.882970 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.883156 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.883446 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.883901 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.884093 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.884412 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.884729 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.885045 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.885453 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.885768 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.886255 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.886599 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.886920 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.887271 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.887620 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.887947 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.888271 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.888594 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.888912 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.889284 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.889556 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.889874 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.890212 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.890534 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.890853 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.891191 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.891683 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.891926 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.892255 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.892578 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.892901 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.893225 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.893548 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.893885 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.894209 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.894534 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.894884 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.895226 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.895572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.895914 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.896250 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.896580 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.896896 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.897226 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.897538 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.897855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.898173 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.898493 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.898808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.899124 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.899726 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.899921 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.900222 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.900429 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.900720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.901070 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.901537 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.902638 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.902638 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.902825 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.903076 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.903448 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.903785 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.904122 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.904447 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.904776 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.905098 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.905434 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.905773 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.906053 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.906387 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.906708 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.907039 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.907379 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.908116 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.908116 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.908488 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.908769 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.909125 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.909581 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.909943 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.910114 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.910449 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.910772 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.911098 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.911473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.911913 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.912209 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.912402 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.912730 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.913405 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.913405 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.913673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.914007 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.914327 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.914654 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.914969 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.915295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.915709 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.916054 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.916905 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.917343 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.917687 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.918011 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.918334 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.918656 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.918972 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.919287 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.919635 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.920012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.920277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.920597 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.920915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.921241 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.921594 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.921875 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.922296 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.922513 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.922855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.923178 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.923542 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.923877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.924194 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.924514 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.924850 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.925173 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.925491 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.925808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.926126 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.926481 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.926802 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.927120 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.927474 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.927811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.928130 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.928459 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.928779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.929098 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.929432 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.929757 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.930135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.930400 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.930723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.931045 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.931417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.931734 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.932813 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.933031 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.933353 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.933672 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.933995 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.934326 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.934919 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.935267 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.935620 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.935953 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.936205 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 10 17:43:45.936673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.936764 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 10 17:43:45.936858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.937012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.937103 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 10 17:43:45.937259 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.937378 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 10 17:43:45.937612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.937758 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 10 17:43:45.937942 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.938039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.938237 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.938330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.938556 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.938663 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.938873 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.938965 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.939195 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.939429 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.939526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.939810 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.939912 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.940144 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.940253 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.940470 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.940576 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.940783 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.940932 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.941071 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.941161 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.941365 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.941472 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.941699 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841302-2-iscsi {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.941943 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.942047 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.942134 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.942325 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.942428 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.942648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.942752 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.942988 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.943147 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.943273 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.943390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.943629 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.943723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.943944 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.944043 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.944259 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.944457 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.944573 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.944776 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.944914 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.945404 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.945511 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.945756 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.945850 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.946106 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.946198 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.946428 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.946597 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.946740 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.946832 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.947066 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.947159 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.947420 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.947519 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.947775 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.947913 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.948092 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.948435 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.948435 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.948591 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841302-2-iscsi {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.948808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.948975 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.949127 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.949231 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.949440 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.949547 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.949762 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.949870 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.950080 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.950190 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.950400 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.950515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.950753 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.950870 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.951019 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.951153 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.951336 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.951522 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.951673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.951792 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.952039 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.952174 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.952316 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.952410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.952634 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.952727 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.952947 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.953069 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.953268 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.953388 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.953584 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.953687 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.953897 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.953998 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.954208 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.954308 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.954520 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.954652 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.954774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.954887 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.955074 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.955166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.955435 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.955580 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.955766 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.955882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.956083 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.956176 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.956340 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.956451 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.956597 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.956692 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.956925 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.957025 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.957250 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.957352 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.957564 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.957671 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.957876 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.957968 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.958187 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.958281 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.958499 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.958591 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.958809 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.958901 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.959121 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.959205 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.959459 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.959571 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.959775 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.959887 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.960100 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.960197 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.960417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.960522 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.960731 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.960963 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.961071 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.961208 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.961347 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.961447 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.961665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.961771 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.961977 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.962093 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.962292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.962407 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.962606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.962708 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.962917 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.963017 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.963229 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.963903 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.964112 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.964235 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.964523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.964689 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.964824 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.964913 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.965047 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.965149 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.965360 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.965460 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.965714 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.965817 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.966028 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.966121 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.966373 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.966519 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.966663 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.966801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.966926 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.967020 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.967240 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.967340 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.967591 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.967774 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.967904 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.968005 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.968220 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.968313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.968534 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.968640 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.968842 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.968935 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.969156 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.969247 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.969467 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.969618 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.969785 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.969937 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.970093 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.970193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.970409 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.970511 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.970724 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.970816 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.971039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.971154 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.971348 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.971480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.971683 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.971779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.972006 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.972099 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.972366 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.972471 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.972637 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.972737 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.972948 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.973049 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.973261 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.973355 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.973572 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.973673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.973889 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.973988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.974197 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.974288 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.974507 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.974607 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.974828 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.974931 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.975140 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.975240 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.975475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.975587 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.975787 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.975896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.976099 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.976190 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.976410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.976510 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.976723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.976874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.977028 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.977178 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.977342 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.977463 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.977666 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.977761 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.977979 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.978081 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.978289 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.978382 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.978596 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.978688 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.978932 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.979606 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.979845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.979959 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.980283 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.980377 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.980600 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.980709 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.980912 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.981003 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.981221 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.981325 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.981541 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.981646 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.981867 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.981967 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.982183 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.982276 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.982501 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.982615 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.982812 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.982927 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.983137 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 10 17:43:45.983238 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.983503 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.983619 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.983844 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.983944 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.984192 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.984283 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.984507 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.984603 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.984827 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.984919 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.985163 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.985264 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.985478 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.985572 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.985792 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.985925 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.986104 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.986195 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.986433 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.986533 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.986746 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.986845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.987059 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.987170 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.987386 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.987588 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.987781 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.987912 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.988104 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.988228 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.988442 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.988659 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.988754 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.988983 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.989074 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.989305 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.989398 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.989638 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.989737 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.989971 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.990070 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.990305 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.990402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.990620 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.990720 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.990943 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.991034 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.991295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.991419 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.991617 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.991716 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.991952 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.992059 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.992274 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.992367 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.992600 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.992735 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.992919 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.993069 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.993279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.993380 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.993615 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.993708 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.993941 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.994043 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.994275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.994367 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.994689 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.994787 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.995048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.995139 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.995416 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.995525 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.995724 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.995824 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.996050 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.996134 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.996365 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.996479 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.996681 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.996783 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.996999 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.997093 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.997313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.997413 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.997628 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.997720 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.997942 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.998036 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.998261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.998360 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.998574 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.998679 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.998968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.999083 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.999205 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.999305 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.999544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.999657 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:45.999907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.000041 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.000163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.000258 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.000455 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.000562 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.000766 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.000858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.001092 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.001196 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.001425 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.001544 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.001735 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.001831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.002053 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.002145 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.002369 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.002470 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.002689 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.002811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.003002 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.003107 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.003310 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.003458 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.003641 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.003748 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.003957 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.004089 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.004270 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.004398 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.004579 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.004701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.004905 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.005039 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.005218 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.005346 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.005562 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.005721 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.005839 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.005945 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.006150 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.006280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.006458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.006578 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.006776 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.006885 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.007090 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.007226 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.007422 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.007532 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.007739 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.007846 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.008115 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.008215 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.008430 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.008531 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.008744 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.008847 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.009059 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.009151 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.009375 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.009475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.009690 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.009783 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.010002 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.010096 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.010527 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.010623 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.010908 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.011002 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.011232 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.011331 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.011574 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.011798 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.011923 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.012028 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.012228 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.012358 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.012548 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.012649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.012866 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.012970 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.013180 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.013274 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.013490 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.013592 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.013798 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.013899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.014108 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.014208 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.014418 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.014521 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.014727 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.014821 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.015055 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.015147 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.015386 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.015501 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.015700 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.015796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.016006 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.016098 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.016315 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.016417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.016659 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.016751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.016967 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.017060 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.017317 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.017411 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.017645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.017743 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.017964 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.018056 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.018289 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.018389 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.018604 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.018703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.018924 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.019018 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.019237 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.019591 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.019691 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.019920 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.020026 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.020237 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.020339 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.020560 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.020660 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.020875 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.020967 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.021197 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.021298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.021509 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.021668 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.021831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.021926 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.022145 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.022238 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.022467 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.022570 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.022775 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.022884 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.023095 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.023199 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.023457 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.023554 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.023793 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.023883 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.024114 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.024216 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.024440 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.024540 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.024756 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.024864 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.025077 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.025178 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.025390 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.025482 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.025706 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.026552 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.026693 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.026866 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.027027 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.027285 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.027593 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.027718 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.028163 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.028272 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.028272 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.028447 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.028549 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.028644 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.028927 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.029034 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.029188 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.029281 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.029625 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.029742 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.029830 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.029916 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.030167 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.030279 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.030503 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.030617 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.030777 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.030871 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.031094 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.031196 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.031438 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.031548 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.031833 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.031942 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.032072 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.032231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.032412 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.032621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.032718 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.032812 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.032990 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.033134 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.033304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.033572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.033678 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.033902 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.034004 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.034223 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.034324 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.034530 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.034624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.034847 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.034953 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.035161 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.035253 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.035489 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.035584 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.035801 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.035955 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.036118 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.036219 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.036444 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.036575 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.036760 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.036862 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.037090 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.037182 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.037404 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.037562 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.037715 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.037818 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.038027 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.038120 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.038340 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.038432 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.038654 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.038747 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.038964 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.039064 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.039273 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.039532 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.039643 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.039891 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.039993 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.040217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.040317 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.040549 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.040653 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.040872 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.040966 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.041197 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.041296 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.042083 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.042313 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.042431 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.042544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.042730 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.042934 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.043046 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.043255 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.043349 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.043611 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.043717 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.043933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.044041 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.044249 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.044351 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.044570 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.044663 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.044890 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.044996 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.045208 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.045301 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.045525 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.045624 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.045842 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.045944 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.046157 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.046259 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.046473 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.046580 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.046794 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.046920 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.047100 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.047213 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.047443 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.047542 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.047762 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.047866 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.048077 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.048338 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.048447 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.048676 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.048778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.048997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.049090 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.049312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.049421 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.049631 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.049725 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.049945 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.050046 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.050264 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.050367 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.050580 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.050724 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.050897 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.050998 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.051233 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.051333 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.051579 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.051700 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.051885 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.051980 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.052198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.052314 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.052515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.052619 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.052824 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.052909 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.053132 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.053232 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.053442 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.053540 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.053776 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.053869 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.054115 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.054206 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.054423 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.054516 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.054731 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.054999 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.055100 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.055341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.055499 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.055673 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.055768 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.055988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.056081 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.056298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.056395 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.056625 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.056720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.056939 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.057072 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.057341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.057474 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.057664 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.057814 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.057969 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.058136 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.058316 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.058460 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.058625 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.058784 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.058965 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.059105 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.059297 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.059467 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.059666 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.059790 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.059980 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.060110 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.060291 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.060431 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.060659 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.060759 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.061018 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.061111 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.061331 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.061437 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.061692 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.061800 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.061953 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.062046 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.062271 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.062390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.062580 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.062686 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.062895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.063031 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.063224 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.063330 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.063535 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.063642 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.063848 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.063950 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.064153 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.064249 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.064466 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.064559 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.064774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.064873 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.065092 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.065193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.065403 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.065503 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.065709 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.065812 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.066015 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.066116 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.066329 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.066515 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.066638 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.066837 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.066971 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.067168 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.067271 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.067642 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.067855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.067994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.068213 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.068313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.068468 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.068572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.068776 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.068873 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.069089 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.069182 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.069400 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.069502 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.069706 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.069799 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.070295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.070403 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.070609 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.070711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.070916 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.071010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.071225 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.071319 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.071560 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.071668 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.071871 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.071966 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.072179 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.072286 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.072495 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.072601 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.072890 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.073030 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.073206 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.073379 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.073535 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.073650 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.073823 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.073945 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.074136 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.074238 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.074451 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.074547 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.074765 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.074865 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.075080 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.075186 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.075417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.075515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.075733 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.075826 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.076048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.076181 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.076362 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.076495 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.076676 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.076764 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.076990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.077104 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.077299 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.077393 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.077618 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.077713 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.077930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.078075 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.078242 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.078337 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.078555 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.078649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.078870 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.078996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.079178 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.079444 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.079542 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.079768 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.079880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.080091 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.080192 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.080493 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.080604 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.080813 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.080917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.081135 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.081227 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.081450 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.081549 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.081786 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.081886 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.082118 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.082214 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.082447 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.082564 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.082770 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.082891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.083077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.083178 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.083401 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.083540 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.083766 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.083869 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.084044 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.084137 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.084360 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.084454 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.084688 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.084790 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.085006 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.085098 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.085331 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.085423 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.085641 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.085735 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.085954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.086057 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.086268 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.086375 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.086581 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.086687 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.086896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.086997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.087211 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.087313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.087552 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.087647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.087871 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.088004 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.088189 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.088824 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.089046 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.089219 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.089377 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.089552 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.089699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.089870 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.090023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.090195 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.090353 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.090631 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.090751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.090856 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.091006 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.091149 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.091344 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.091490 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.091704 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.091799 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.092043 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.092144 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.092402 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.092495 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.093230 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.093396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.093497 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.093586 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.093586 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.094006 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.094115 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.094213 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.094300 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.094393 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.094490 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.094591 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.094688 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123753) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 17:43:46.094777 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.094972 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.095292 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.095635 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.095948 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.096372 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.096689 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.097006 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.097322 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.097634 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.097944 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.098260 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.098591 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.098901 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.099210 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.099542 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.099870 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.100185 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.100512 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.100934 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.101251 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.101558 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.101978 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.102291 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.102606 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.102932 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.103256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.103605 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.104020 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.104963 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.105284 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.105612 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.105943 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.106261 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.106582 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.106895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.107226 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.107580 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.107902 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.108230 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.108656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.108982 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.109298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.109627 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.109959 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.110269 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.110578 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.118341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.118341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.118341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.118341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.118341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.118341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.118341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.118341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.118992 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.118992 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.118992 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.118992 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.118992 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.118992 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.118992 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.118992 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.119662 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.119662 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.119662 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.119662 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.119662 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.119662 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.119662 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.119662 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.120158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.120158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.120158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.120158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.120591 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_db.sqlalchemy.engines [None req-2c29550d-bc74-4ea3-9e4f-d3d0b48661d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:43:46.120711 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.120711 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.120711 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.120711 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.121405 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.121405 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.121628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.121951 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.122214 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.122639 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.122832 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.123132 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.123716 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.123852 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.124159 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.124459 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.124692 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.125019 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.125333 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.125643 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.125951 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.126377 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.126661 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.126894 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.127230 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.127577 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.127905 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.128247 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.128553 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.128879 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.129202 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.129521 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.129840 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.130165 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.130485 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.130803 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.131122 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.131457 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.131777 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.132096 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.132416 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.132983 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.133316 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.133634 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.133950 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.134265 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.134582 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.134898 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.135288 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.135636 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.136026 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.136343 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.136677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.137006 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.137338 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.137677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.138032 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.138316 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.138637 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.138952 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.139625 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.140043 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.140345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.140667 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.141260 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.141582 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.141905 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.142302 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.142797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.143125 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.143466 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.143785 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.144103 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.144423 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.144753 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.145093 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.145416 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.145734 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.146051 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.146370 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.146923 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.147241 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.147602 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.147935 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.148262 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.148581 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.148904 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.149232 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.149542 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.149850 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.150165 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.150478 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.151322 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.151671 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.151987 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.152300 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.152622 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.152934 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.153475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.153827 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.154148 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.154481 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.154812 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.155132 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.155472 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.155802 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.156112 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.156421 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.156740 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.157057 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.157373 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.157684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.158000 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.158312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.158621 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.158936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.159248 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.159601 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.159912 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.160222 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.160534 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.160848 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.161158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.161470 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.161780 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.162088 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.162403 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.162713 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.163026 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.163328 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.163668 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.163977 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.164289 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.164662 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.164983 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.165291 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.165601 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.165924 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.166239 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.167124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.167679 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.168138 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.168499 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.168923 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.169782 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.170120 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.170712 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.171067 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.171420 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.171812 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.172201 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.172513 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.172844 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.173161 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.173479 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.173795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.174112 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.174427 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.174742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.175053 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.175400 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.175698 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.176013 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.176422 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.176752 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.177070 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.177485 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.177821 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.178188 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.178451 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.178775 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.179122 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.179577 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.179894 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.180210 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.180531 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.180865 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.181184 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.181494 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.181929 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.182284 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.182609 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.182936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.183250 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.183600 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.183929 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.184245 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.184570 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.184886 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.185220 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.185565 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.185899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.186229 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.186540 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.186852 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.187035 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.context [None req-2c29550d-bc74-4ea3-9e4f-d3d0b48661d6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87(cell1) {{(pid=123753) load_cells /opt/stack/nova/nova/context.py:464}} May 10 17:43:46.187167 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.187505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.187832 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.188146 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.188452 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.188759 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.189074 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.189383 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.189690 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.189997 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.190304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.190615 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.190921 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.191228 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.191492 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2c29550d-bc74-4ea3-9e4f-d3d0b48661d6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:43:46.191602 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.191913 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.192223 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.192530 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.192842 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.193080 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2c29550d-bc74-4ea3-9e4f-d3d0b48661d6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:43:46.193173 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.193439 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.193860 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.193953 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2c29550d-bc74-4ea3-9e4f-d3d0b48661d6 None None] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:43:46.194178 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.194540 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.195297 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.196014 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.196014 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.196361 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2c29550d-bc74-4ea3-9e4f-d3d0b48661d6 None None] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:43:46.196497 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.196497 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.196822 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.197142 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.197466 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.197938 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.198169 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.198573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.204259 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.204259 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.204259 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.204259 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.204259 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.204259 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.204259 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.204259 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.205244 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.205244 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.205244 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.205244 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.205244 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.205244 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.205244 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.205244 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.206061 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.206061 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.206061 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.206061 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.206061 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.206061 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.206061 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.206774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.206774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.206774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.207081 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.207457 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.207779 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.208134 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.208798 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.208983 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_db.sqlalchemy.engines [None req-2c29550d-bc74-4ea3-9e4f-d3d0b48661d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:43:46.209182 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.209506 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.209821 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 10 17:43:46.210084 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 10 17:43:46.210693 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_db.sqlalchemy.engines [None req-2c29550d-bc74-4ea3-9e4f-d3d0b48661d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:43:46.239946 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_db.sqlalchemy.engines [None req-f46bc837-4d45-4b98-8311-270e9a1a4ef5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:43:46.305816 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.context [None req-f46bc837-4d45-4b98-8311-270e9a1a4ef5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87(cell1) {{(pid=123752) load_cells /opt/stack/nova/nova/context.py:464}} May 10 17:43:46.311292 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f46bc837-4d45-4b98-8311-270e9a1a4ef5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:43:46.313232 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f46bc837-4d45-4b98-8311-270e9a1a4ef5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:43:46.314069 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f46bc837-4d45-4b98-8311-270e9a1a4ef5 None None] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:43:46.316058 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f46bc837-4d45-4b98-8311-270e9a1a4ef5 None None] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:43:46.333050 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_db.sqlalchemy.engines [None req-f46bc837-4d45-4b98-8311-270e9a1a4ef5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:43:46.334002 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_db.sqlalchemy.engines [None req-f46bc837-4d45-4b98-8311-270e9a1a4ef5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:43:46.384223 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_db.sqlalchemy.engines [None req-2c29550d-bc74-4ea3-9e4f-d3d0b48661d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123753) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:43:46.501228 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_db.sqlalchemy.engines [None req-f46bc837-4d45-4b98-8311-270e9a1a4ef5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 10 17:43:46.716760 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: WARNING keystonemiddleware.auth_token [None req-2c29550d-bc74-4ea3-9e4f-d3d0b48661d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 17:43:46.724363 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: WARNING keystonemiddleware.auth_token [None req-2c29550d-bc74-4ea3-9e4f-d3d0b48661d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 17:43:46.842933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: WARNING keystonemiddleware.auth_token [None req-f46bc837-4d45-4b98-8311-270e9a1a4ef5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 17:43:46.850223 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: WARNING keystonemiddleware.auth_token [None req-f46bc837-4d45-4b98-8311-270e9a1a4ef5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 17:43:47.077604 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: WARNING keystonemiddleware.auth_token [None req-2c29550d-bc74-4ea3-9e4f-d3d0b48661d6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 17:43:47.084321 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: WARNING keystonemiddleware.auth_token [None req-2c29550d-bc74-4ea3-9e4f-d3d0b48661d6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 17:43:47.090788 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56468b8479c0 pid: 123753 (default app) May 10 17:43:47.203613 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: WARNING keystonemiddleware.auth_token [None req-f46bc837-4d45-4b98-8311-270e9a1a4ef5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 10 17:43:47.210188 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: WARNING keystonemiddleware.auth_token [None req-f46bc837-4d45-4b98-8311-270e9a1a4ef5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 10 17:43:47.217034 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56468b8479c0 pid: 123752 (default app) May 10 17:44:31.215850 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5edd1ca3-7acb-4e98-8e8f-f9cdeb76b5ed tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Action: 'create', calling method: .version_select at 0x7f3e788a8280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-49774862"}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:44:33.056965 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cfefd521-e3dc-45e9-b877-24acbd6ad5f4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1803008971", "imageRef": "a7737c62-8029-44aa-8da7-e46fea7607fb", "flavorRef": "452", "networks": [{"uuid": "4530795e-c50a-4eb4-a3c5-419871214a37"}]}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:44:33.693247 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-cfefd521-e3dc-45e9-b877-24acbd6ad5f4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] validate_networks() for [('4530795e-c50a-4eb4-a3c5-419871214a37', None, None, None, None, None)] {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:44:34.001546 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-5edd1ca3-7acb-4e98-8e8f-f9cdeb76b5ed tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 4.028880 May 10 17:44:34.009579 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 1/1] 10.222.0.60 () {60 vars in 1154 bytes} [Tue May 10 17:44:29 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 4039 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 17:44:34.015270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e314a93f-3615-4c29-9bdd-e6785f657fa0 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Calling method '.version_select at 0x7f3e78700280>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:34.358788 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e314a93f-3615-4c29-9bdd-e6785f657fa0 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ea9df00b-fc5b-4b01-ae6b-d3946fbd775e" status: 200 len: 343 microversion: 2.1 time: 0.347524 May 10 17:44:34.365126 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 2/2] 10.222.0.60 () {58 vars in 1244 bytes} [Tue May 10 17:44:34 2022] GET /compute/v2.1/os-volumes/ea9df00b-fc5b-4b01-ae6b-d3946fbd775e => generated 343 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:44:35.375765 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c72c4089-fa9c-44f9-9949-03946367999c tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Calling method '.version_select at 0x7f3e78700430>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:35.475282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c72c4089-fa9c-44f9-9949-03946367999c tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ea9df00b-fc5b-4b01-ae6b-d3946fbd775e" status: 200 len: 344 microversion: 2.1 time: 0.106003 May 10 17:44:35.476159 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 3/3] 10.222.0.60 () {58 vars in 1244 bytes} [Tue May 10 17:44:35 2022] GET /compute/v2.1/os-volumes/ea9df00b-fc5b-4b01-ae6b-d3946fbd775e => generated 344 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:44:35.490193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f9847be5-7450-498e-9a73-b88470832661 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Action: 'create', calling method: .version_select at 0x7f3e78700940>, body: {"snapshot": {"volume_id": "ea9df00b-fc5b-4b01-ae6b-d3946fbd775e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-633416223"}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:44:35.973554 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cfefd521-e3dc-45e9-b877-24acbd6ad5f4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:44:35.975662 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cfefd521-e3dc-45e9-b877-24acbd6ad5f4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:44:35.976514 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cfefd521-e3dc-45e9-b877-24acbd6ad5f4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:44:35.977137 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cfefd521-e3dc-45e9-b877-24acbd6ad5f4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:44:35.978324 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cfefd521-e3dc-45e9-b877-24acbd6ad5f4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:44:36.010758 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cfefd521-e3dc-45e9-b877-24acbd6ad5f4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:36.011225 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cfefd521-e3dc-45e9-b877-24acbd6ad5f4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:36.012161 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cfefd521-e3dc-45e9-b877-24acbd6ad5f4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:36.012774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cfefd521-e3dc-45e9-b877-24acbd6ad5f4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:36.072472 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-cfefd521-e3dc-45e9-b877-24acbd6ad5f4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Getting quotas for project 98c641670665465caa49f5d709911793. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:44:36.085069 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-cfefd521-e3dc-45e9-b877-24acbd6ad5f4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Getting quotas for user ca6c3d8d36db4f5fbc6c24834f81f599 and project 98c641670665465caa49f5d709911793. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:44:36.109967 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cfefd521-e3dc-45e9-b877-24acbd6ad5f4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:44:36.114283 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cfefd521-e3dc-45e9-b877-24acbd6ad5f4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7737c62-8029-44aa-8da7-e46fea7607fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:44:36.126829 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f9847be5-7450-498e-9a73-b88470832661 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.642179 May 10 17:44:36.127434 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 4/4] 10.222.0.60 () {60 vars in 1161 bytes} [Tue May 10 17:44:35 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:44:36.139596 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2f1ab5e4-c10e-4d82-a1a2-5506a1cfa997 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Calling method '.version_select at 0x7f3e787055e0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:36.253080 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-2f1ab5e4-c10e-4d82-a1a2-5506a1cfa997 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce" status: 200 len: 286 microversion: 2.1 time: 0.111989 May 10 17:44:36.253700 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 5/5] 10.222.0.60 () {58 vars in 1250 bytes} [Tue May 10 17:44:36 2022] GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce => generated 286 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:44:36.286304 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4189154b-53ae-42d8-9a99-3236b9244a8f tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Calling method '.version_select at 0x7f3e78700e50>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:36.336957 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cfefd521-e3dc-45e9-b877-24acbd6ad5f4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.586637 May 10 17:44:36.338010 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 1/6] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 17:44:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 4595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:44:36.365216 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6fc0826b-6ea8-4771-a30a-8295003851bb tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:36.367548 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6fc0826b-6ea8-4771-a30a-8295003851bb tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:36.428521 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4189154b-53ae-42d8-9a99-3236b9244a8f tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.168753 May 10 17:44:36.430210 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 6/7] 10.222.0.60 () {58 vars in 1139 bytes} [Tue May 10 17:44:36 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:44:36.443480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-19de4671-36d2-4d29-9986-3cb47d13aa48 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Calling method '.version_select at 0x7f3e78705280>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:36.498570 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-19de4671-36d2-4d29-9986-3cb47d13aa48 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce" status: 200 len: 286 microversion: 2.1 time: 0.060506 May 10 17:44:36.499132 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 7/8] 10.222.0.60 () {58 vars in 1250 bytes} [Tue May 10 17:44:36 2022] GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce => generated 286 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:44:36.904868 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6fc0826b-6ea8-4771-a30a-8295003851bb tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:44:36.928382 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6fc0826b-6ea8-4771-a30a-8295003851bb tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1215 microversion: 2.1 time: 0.582279 May 10 17:44:36.929779 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 2/9] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:36 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1215 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:44:37.511615 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-03908b5a-6835-4826-9af4-64349ecb78e0 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Calling method '.version_select at 0x7f3e787051f0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:37.596262 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-03908b5a-6835-4826-9af4-64349ecb78e0 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce" status: 200 len: 286 microversion: 2.1 time: 0.089908 May 10 17:44:37.596888 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 8/10] 10.222.0.60 () {58 vars in 1250 bytes} [Tue May 10 17:44:37 2022] GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:44:37.951399 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-17c5ec5e-3fc5-453b-b43b-f218de4fa86b tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:37.952041 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-17c5ec5e-3fc5-453b-b43b-f218de4fa86b tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:38.130176 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-17c5ec5e-3fc5-453b-b43b-f218de4fa86b tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:44:38.143827 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-17c5ec5e-3fc5-453b-b43b-f218de4fa86b tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1215 microversion: 2.1 time: 0.198243 May 10 17:44:38.147098 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 3/11] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:37 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1215 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:44:38.609168 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ac9be756-a7e7-486a-9b90-ef070a7332d9 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Calling method '.version_select at 0x7f3e787003a0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:38.750726 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ac9be756-a7e7-486a-9b90-ef070a7332d9 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce" status: 200 len: 286 microversion: 2.1 time: 0.145346 May 10 17:44:38.751904 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 9/12] 10.222.0.60 () {58 vars in 1250 bytes} [Tue May 10 17:44:38 2022] GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce => generated 286 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:44:39.163797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e6fc5d9e-0250-4999-bd90-48f075097bc9 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:39.165465 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e6fc5d9e-0250-4999-bd90-48f075097bc9 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:39.186184 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e6fc5d9e-0250-4999-bd90-48f075097bc9 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:39.186942 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e6fc5d9e-0250-4999-bd90-48f075097bc9 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:39.189759 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e6fc5d9e-0250-4999-bd90-48f075097bc9 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:39.190545 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e6fc5d9e-0250-4999-bd90-48f075097bc9 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:39.550862 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e6fc5d9e-0250-4999-bd90-48f075097bc9 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:44:39.572578 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e6fc5d9e-0250-4999-bd90-48f075097bc9 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1219 microversion: 2.1 time: 0.412900 May 10 17:44:39.584613 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 4/13] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:39 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1219 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:44:39.768180 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c29f3547-2f72-4890-88b8-5cec9a03a60d tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Calling method '.version_select at 0x7f3e78700940>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:39.819916 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c29f3547-2f72-4890-88b8-5cec9a03a60d tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce" status: 200 len: 286 microversion: 2.1 time: 0.059945 May 10 17:44:39.820831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 10/14] 10.222.0.60 () {58 vars in 1250 bytes} [Tue May 10 17:44:39 2022] GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:44:40.591211 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-89b4df72-0bc6-41ee-920c-5869128ede40 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:40.593887 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-89b4df72-0bc6-41ee-920c-5869128ede40 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:40.608735 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-89b4df72-0bc6-41ee-920c-5869128ede40 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:40.616385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-89b4df72-0bc6-41ee-920c-5869128ede40 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:40.617777 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-89b4df72-0bc6-41ee-920c-5869128ede40 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:40.618975 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-89b4df72-0bc6-41ee-920c-5869128ede40 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:40.813767 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-89b4df72-0bc6-41ee-920c-5869128ede40 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:44:40.824888 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-89b4df72-0bc6-41ee-920c-5869128ede40 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1219 microversion: 2.1 time: 0.238099 May 10 17:44:40.830788 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 5/15] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:40 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1219 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:44:40.843858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-368bb0af-bec2-404f-9cac-b6f2da098354 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Calling method '.version_select at 0x7f3e78705040>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:40.901590 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-368bb0af-bec2-404f-9cac-b6f2da098354 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce" status: 200 len: 286 microversion: 2.1 time: 0.073705 May 10 17:44:40.902223 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 11/16] 10.222.0.60 () {58 vars in 1250 bytes} [Tue May 10 17:44:40 2022] GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:44:41.848145 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-33c9df7c-0a59-4dfe-a471-5a2af8b57722 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:41.848781 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-33c9df7c-0a59-4dfe-a471-5a2af8b57722 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:41.860527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-33c9df7c-0a59-4dfe-a471-5a2af8b57722 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:41.863429 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-33c9df7c-0a59-4dfe-a471-5a2af8b57722 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:41.865206 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-33c9df7c-0a59-4dfe-a471-5a2af8b57722 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:41.869588 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-33c9df7c-0a59-4dfe-a471-5a2af8b57722 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:41.913163 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2918e43f-fe29-498c-9194-c9ba8960ee8c tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Calling method '.version_select at 0x7f3e78705820>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:41.968384 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-2918e43f-fe29-498c-9194-c9ba8960ee8c tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce" status: 200 len: 286 microversion: 2.1 time: 0.058917 May 10 17:44:41.972760 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 12/17] 10.222.0.60 () {58 vars in 1250 bytes} [Tue May 10 17:44:41 2022] GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:44:42.023585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-33c9df7c-0a59-4dfe-a471-5a2af8b57722 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:44:42.049339 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-33c9df7c-0a59-4dfe-a471-5a2af8b57722 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1219 microversion: 2.1 time: 0.204913 May 10 17:44:42.053089 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 6/18] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:41 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1219 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:44:42.989899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b7e008d1-93c1-412e-96d4-afd3b2d1bc33 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Calling method '.version_select at 0x7f3e78700ca0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:43.071225 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-18bfb44c-e997-4840-806c-e6e3c58e6825 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:43.072839 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-18bfb44c-e997-4840-806c-e6e3c58e6825 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:43.074694 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b7e008d1-93c1-412e-96d4-afd3b2d1bc33 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce" status: 200 len: 287 microversion: 2.1 time: 0.097604 May 10 17:44:43.081732 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 13/19] 10.222.0.60 () {58 vars in 1250 bytes} [Tue May 10 17:44:42 2022] GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:44:43.085788 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-18bfb44c-e997-4840-806c-e6e3c58e6825 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:43.086267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-18bfb44c-e997-4840-806c-e6e3c58e6825 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:43.087884 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-3a6a3765-4170-4197-b407-4edfd04fe412 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Calling method '.version_select at 0x7f3e78700040>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:43.088238 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-18bfb44c-e997-4840-806c-e6e3c58e6825 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:43.088705 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-18bfb44c-e997-4840-806c-e6e3c58e6825 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:43.266941 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-3a6a3765-4170-4197-b407-4edfd04fe412 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "DELETE /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce" status: 202 len: 0 microversion: 2.1 time: 0.184022 May 10 17:44:43.271024 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 14/20] 10.222.0.60 () {58 vars in 1253 bytes} [Tue May 10 17:44:43 2022] DELETE /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:44:43.277648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-59646988-1f91-47f2-ab20-60afb448742c tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Calling method '.version_select at 0x7f3e78705940>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:43.330911 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-59646988-1f91-47f2-ab20-60afb448742c tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce" status: 200 len: 286 microversion: 2.1 time: 0.058231 May 10 17:44:43.331107 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 15/21] 10.222.0.60 () {58 vars in 1250 bytes} [Tue May 10 17:44:43 2022] GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce => generated 286 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:44:43.976563 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-18bfb44c-e997-4840-806c-e6e3c58e6825 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:44:44.023688 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-18bfb44c-e997-4840-806c-e6e3c58e6825 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1267 microversion: 2.1 time: 0.949913 May 10 17:44:44.033894 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 7/22] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:43 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1267 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:44:44.349612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-141eda85-5aff-431b-93d2-8a460f5acc77 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Calling method '.version_select at 0x7f3e78705430>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:44.427778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-141eda85-5aff-431b-93d2-8a460f5acc77 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] HTTP exception thrown: Snapshot 00d52167-9e73-4afb-aad4-32471caff1ce could not be found. May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-141eda85-5aff-431b-93d2-8a460f5acc77 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Request method failure captured: May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce HTTP/1.1 May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqR9Pu9ai4-tJvRyOczOA5RqIvdq7CEJC0MFvLxc8bLBCElvRKbXl-ExIgZh_pV43s1dzprQHM_8mZM2mzAKa299O6kCBMn7iNdFG9hIb4DIBHIyet6PCRk3YKS7KT5u3UPO3UWHzaWpDJy2aOsVLR6AlPaTfHcv1J9ctx2M9CvXYFQ May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: 39a2edf9ed6b480a9863609f51689013 May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-10272551 May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:44:44.436936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:44:44.437952 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/39a2edf9ed6b480a9863609f51689013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/39a2edf9ed6b480a9863609f51689013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_39a2edf9ed6b480a9863609f51689013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/39a2edf9ed6b480a9863609f51689013"}]}] May 10 17:44:44.437952 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-VolumesSnapshotsTestJSON-10272551 May 10 17:44:44.437952 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: 39a2edf9ed6b480a9863609f51689013 May 10 17:44:44.437952 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-10272551 May 10 17:44:44.437952 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-VolumesSnapshotsTestJSON-10272551-project May 10 17:44:44.437952 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:44:44.437952 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:44:44.437952 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: 99eceaf1a3984d189ace4ce96827867c May 10 17:44:44.437952 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-VolumesSnapshotsTestJSON-10272551-project May 10 17:44:44.437952 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: May 10 17:44:44.437952 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Snapshot 00d52167-9e73-4afb-aad4-32471caff1ce could not be found. May 10 17:44:44.437952 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': '00d52167-9e73-4afb-aad4-32471caff1ce'} May 10 17:44:44.437952 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:44:44.438647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:44:44.438647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 17:44:44.438647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 17:44:44.438647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 17:44:44.438647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 17:44:44.438647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 17:44:44.438647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 17:44:44.438647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 17:44:44.438647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 17:44:44.438647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 17:44:44.438647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 17:44:44.438647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 17:44:44.438647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 17:44:44.438647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 17:44:44.438647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 17:44:44.438647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 00d52167-9e73-4afb-aad4-32471caff1ce could not be found. (HTTP 404) (Request-ID: req-15f5fcf4-0adf-45f8-86cf-36d560fd6826) May 10 17:44:44.438647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:44:44.438647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:44:44.439523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:44:44.439523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:44:44.439523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 10 17:44:44.439523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 10 17:44:44.439523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 17:44:44.439523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 17:44:44.439523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 10 17:44:44.439523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 10 17:44:44.439523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 17:44:44.439523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 17:44:44.439523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 10 17:44:44.439523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 10 17:44:44.439523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 10 17:44:44.439523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 10 17:44:44.439523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 10 17:44:44.439523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 10 17:44:44.439523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 17:44:44.439523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 17:44:44.439523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 00d52167-9e73-4afb-aad4-32471caff1ce could not be found. May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 10 17:44:44.440406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:44:44.441323 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 00d52167-9e73-4afb-aad4-32471caff1ce could not be found. May 10 17:44:44.441323 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:44:44.441323 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:44:44.441323 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:44:44.441323 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:44:44.441323 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:44:44.441323 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:44:44.441323 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:44:44.441323 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:44:44.441323 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 00d52167-9e73-4afb-aad4-32471caff1ce could not be found. May 10 17:44:44.441323 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:44:44.445190 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-141eda85-5aff-431b-93d2-8a460f5acc77 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Returning 404 to user: Snapshot 00d52167-9e73-4afb-aad4-32471caff1ce could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:44:44.448233 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-141eda85-5aff-431b-93d2-8a460f5acc77 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce" status: 404 len: 111 microversion: 2.1 time: 0.107753 May 10 17:44:44.467506 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 16/23] 10.222.0.60 () {58 vars in 1250 bytes} [Tue May 10 17:44:44 2022] GET /compute/v2.1/os-snapshots/00d52167-9e73-4afb-aad4-32471caff1ce => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:44:44.473205 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4243d119-ce62-4234-96b7-6b317aaa18e3 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Calling method '.version_select at 0x7f3e78705ca0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:44.697182 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4243d119-ce62-4234-96b7-6b317aaa18e3 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/ea9df00b-fc5b-4b01-ae6b-d3946fbd775e" status: 202 len: 0 microversion: 2.1 time: 0.228379 May 10 17:44:44.700966 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 17/24] 10.222.0.60 () {58 vars in 1247 bytes} [Tue May 10 17:44:44 2022] DELETE /compute/v2.1/os-volumes/ea9df00b-fc5b-4b01-ae6b-d3946fbd775e => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:44:44.705731 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e9a5d332-2138-4b85-94a3-b104c963c939 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Calling method '.version_select at 0x7f3e787058b0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:44.851603 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e9a5d332-2138-4b85-94a3-b104c963c939 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ea9df00b-fc5b-4b01-ae6b-d3946fbd775e" status: 200 len: 343 microversion: 2.1 time: 0.149466 May 10 17:44:44.852688 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 18/25] 10.222.0.60 () {58 vars in 1244 bytes} [Tue May 10 17:44:44 2022] GET /compute/v2.1/os-volumes/ea9df00b-fc5b-4b01-ae6b-d3946fbd775e => generated 343 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:44:45.043712 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-35b20926-1a71-43fa-8e4b-b1c6a1ecac93 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:45.044681 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-35b20926-1a71-43fa-8e4b-b1c6a1ecac93 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:45.113300 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-35b20926-1a71-43fa-8e4b-b1c6a1ecac93 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:45.113677 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-35b20926-1a71-43fa-8e4b-b1c6a1ecac93 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:45.115019 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-35b20926-1a71-43fa-8e4b-b1c6a1ecac93 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:45.119730 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-35b20926-1a71-43fa-8e4b-b1c6a1ecac93 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:45.198394 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c1c0b224-225d-4e75-97b0-cc0000d83875 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Action: 'create', calling method: .version_select at 0x7f3e775d6550>, body: {"keypair": {"name": "tempest-keypair-1037564527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFksS9tKtTkqohk2mh1NFgJ6EJXf21xll0H6ze4s+emysS6uDkQaGyLbp5uG0VBStdlJbIqzr0WLhR/oVAADRjFURTSdMWXz1IwSW7Kpf0LdpHsDxbrqCQB2kNaSWfs2Vw=="}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:44:45.224161 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-c1c0b224-225d-4e75-97b0-cc0000d83875 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Getting quotas for project 0461acfadf8743fdbd62a39bf3fe3e1c. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:44:45.229250 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-c1c0b224-225d-4e75-97b0-cc0000d83875 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Getting quotas for user ed37128b78a6454c9c387ad91995a05d and project 0461acfadf8743fdbd62a39bf3fe3e1c. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:44:45.276388 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c1c0b224-225d-4e75-97b0-cc0000d83875 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.898597 May 10 17:44:45.282655 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 8/26] 10.222.0.60 () {62 vars in 1199 bytes} [Tue May 10 17:44:44 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 903 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 17:44:45.869074 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b3b712b7-1930-4ac6-aa28-23ff44201956 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Calling method '.version_select at 0x7f3e775a48b0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:45.896553 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-35b20926-1a71-43fa-8e4b-b1c6a1ecac93 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:44:45.946239 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-35b20926-1a71-43fa-8e4b-b1c6a1ecac93 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1273 microversion: 2.1 time: 0.905838 May 10 17:44:45.948903 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 19/27] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:45 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1273 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:44:46.020979 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-b3b712b7-1930-4ac6-aa28-23ff44201956 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] HTTP exception thrown: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b3b712b7-1930-4ac6-aa28-23ff44201956 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Request method failure captured: May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/os-volumes/ea9df00b-fc5b-4b01-ae6b-d3946fbd775e HTTP/1.1 May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqR9Pu9ai4-tJvRyOczOA5RqIvdq7CEJC0MFvLxc8bLBCElvRKbXl-ExIgZh_pV43s1dzprQHM_8mZM2mzAKa299O6kCBMn7iNdFG9hIb4DIBHIyet6PCRk3YKS7KT5u3UPO3UWHzaWpDJy2aOsVLR6AlPaTfHcv1J9ctx2M9CvXYFQ May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: 39a2edf9ed6b480a9863609f51689013 May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-10272551 May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:44:46.025962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:44:46.027012 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/39a2edf9ed6b480a9863609f51689013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/39a2edf9ed6b480a9863609f51689013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_39a2edf9ed6b480a9863609f51689013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/39a2edf9ed6b480a9863609f51689013"}]}] May 10 17:44:46.027012 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-VolumesSnapshotsTestJSON-10272551 May 10 17:44:46.027012 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 39a2edf9ed6b480a9863609f51689013 May 10 17:44:46.027012 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-10272551 May 10 17:44:46.027012 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-VolumesSnapshotsTestJSON-10272551-project May 10 17:44:46.027012 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:44:46.027012 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:44:46.027012 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: 99eceaf1a3984d189ace4ce96827867c May 10 17:44:46.027012 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-VolumesSnapshotsTestJSON-10272551-project May 10 17:44:46.027012 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: May 10 17:44:46.027012 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. May 10 17:44:46.027012 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': 'ea9df00b-fc5b-4b01-ae6b-d3946fbd775e'} May 10 17:44:46.027012 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:44:46.027742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:44:46.027742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 17:44:46.027742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 17:44:46.027742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 17:44:46.027742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 17:44:46.027742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 17:44:46.027742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 17:44:46.027742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 17:44:46.027742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 17:44:46.027742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 17:44:46.027742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 17:44:46.027742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 17:44:46.027742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 17:44:46.027742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 17:44:46.027742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 17:44:46.027742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. (HTTP 404) (Request-ID: req-83adf5b4-88dd-4ab6-b941-938b81620c41) May 10 17:44:46.027742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:44:46.027742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:44:46.027742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:44:46.028645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:44:46.028645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 17:44:46.028645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 17:44:46.028645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 17:44:46.028645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 17:44:46.028645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 17:44:46.028645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 17:44:46.028645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 17:44:46.028645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 17:44:46.028645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 17:44:46.028645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 17:44:46.028645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 17:44:46.028645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 17:44:46.028645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 17:44:46.028645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 17:44:46.028645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 17:44:46.028645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 17:44:46.028645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 17:44:46.028645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 17:44:46.029538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 17:44:46.029538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 17:44:46.029538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 17:44:46.029538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 17:44:46.029538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. May 10 17:44:46.029538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:44:46.029538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:44:46.029538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:44:46.029538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:44:46.029538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:44:46.029538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:44:46.029538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:44:46.029538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:44:46.029538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 17:44:46.029538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 17:44:46.029538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:44:46.029538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:44:46.029538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 17:44:46.029538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:44:46.030442 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. May 10 17:44:46.030442 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:44:46.030442 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:44:46.030442 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:44:46.030442 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:44:46.030442 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:44:46.030442 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:44:46.030442 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:44:46.030442 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:44:46.030442 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. May 10 17:44:46.030442 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:44:46.032960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b3b712b7-1930-4ac6-aa28-23ff44201956 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Returning 404 to user: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:44:46.034317 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b3b712b7-1930-4ac6-aa28-23ff44201956 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ea9df00b-fc5b-4b01-ae6b-d3946fbd775e" status: 404 len: 109 microversion: 2.1 time: 0.170066 May 10 17:44:46.042849 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 9/28] 10.222.0.60 () {58 vars in 1244 bytes} [Tue May 10 17:44:45 2022] GET /compute/v2.1/os-volumes/ea9df00b-fc5b-4b01-ae6b-d3946fbd775e => generated 109 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:44:46.052333 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-3e5b07fa-e351-41ee-8fa7-74fb8599477b tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Calling method '.version_select at 0x7f3e7860d0d0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:46.141320 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-3e5b07fa-e351-41ee-8fa7-74fb8599477b tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] HTTP exception thrown: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-3e5b07fa-e351-41ee-8fa7-74fb8599477b tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Request method failure captured: May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: DELETE /compute/v2.1/os-volumes/ea9df00b-fc5b-4b01-ae6b-d3946fbd775e HTTP/1.1 May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqR9Pu9ai4-tJvRyOczOA5RqIvdq7CEJC0MFvLxc8bLBCElvRKbXl-ExIgZh_pV43s1dzprQHM_8mZM2mzAKa299O6kCBMn7iNdFG9hIb4DIBHIyet6PCRk3YKS7KT5u3UPO3UWHzaWpDJy2aOsVLR6AlPaTfHcv1J9ctx2M9CvXYFQ May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: 39a2edf9ed6b480a9863609f51689013 May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-10272551 May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:44:46.143142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:44:46.144469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/39a2edf9ed6b480a9863609f51689013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/39a2edf9ed6b480a9863609f51689013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_39a2edf9ed6b480a9863609f51689013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/39a2edf9ed6b480a9863609f51689013"}]}] May 10 17:44:46.144469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-VolumesSnapshotsTestJSON-10272551 May 10 17:44:46.144469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: 39a2edf9ed6b480a9863609f51689013 May 10 17:44:46.144469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-10272551 May 10 17:44:46.144469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-VolumesSnapshotsTestJSON-10272551-project May 10 17:44:46.144469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:44:46.144469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:44:46.144469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: 99eceaf1a3984d189ace4ce96827867c May 10 17:44:46.144469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-VolumesSnapshotsTestJSON-10272551-project May 10 17:44:46.144469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: May 10 17:44:46.144469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. May 10 17:44:46.144469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': 'ea9df00b-fc5b-4b01-ae6b-d3946fbd775e'} May 10 17:44:46.144469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:44:46.145367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:44:46.145367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 17:44:46.145367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 17:44:46.145367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 17:44:46.145367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 17:44:46.145367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 17:44:46.145367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 17:44:46.145367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 17:44:46.145367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 17:44:46.145367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 17:44:46.145367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 17:44:46.145367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 17:44:46.145367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 17:44:46.145367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 17:44:46.145367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 17:44:46.145367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. (HTTP 404) (Request-ID: req-de3a6432-46a6-44e6-99d1-8f9e8710f8a6) May 10 17:44:46.145367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:44:46.145367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:44:46.145367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:44:46.146621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:44:46.146621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 17:44:46.146621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 17:44:46.146621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 17:44:46.146621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 17:44:46.146621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 17:44:46.146621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 17:44:46.146621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 17:44:46.146621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 17:44:46.146621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 17:44:46.146621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 17:44:46.146621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 17:44:46.146621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 17:44:46.146621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 17:44:46.146621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 17:44:46.146621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 17:44:46.146621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 17:44:46.146621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 17:44:46.146621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 17:44:46.151895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 17:44:46.151895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 17:44:46.151895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 17:44:46.151895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 17:44:46.151895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. May 10 17:44:46.151895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:44:46.151895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:44:46.151895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:44:46.151895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:44:46.151895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:44:46.151895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:44:46.151895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:44:46.151895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:44:46.151895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 17:44:46.151895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 17:44:46.151895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:44:46.151895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:44:46.151895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 17:44:46.151895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:44:46.152752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. May 10 17:44:46.152752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:44:46.152752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:44:46.152752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:44:46.152752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:44:46.152752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:44:46.152752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:44:46.152752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:44:46.152752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:44:46.152752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. May 10 17:44:46.152752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:44:46.152752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-3e5b07fa-e351-41ee-8fa7-74fb8599477b tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Returning 404 to user: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:44:46.152752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-3e5b07fa-e351-41ee-8fa7-74fb8599477b tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/ea9df00b-fc5b-4b01-ae6b-d3946fbd775e" status: 404 len: 109 microversion: 2.1 time: 0.096500 May 10 17:44:46.152752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 20/29] 10.222.0.60 () {58 vars in 1247 bytes} [Tue May 10 17:44:46 2022] DELETE /compute/v2.1/os-volumes/ea9df00b-fc5b-4b01-ae6b-d3946fbd775e => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:44:46.155185 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-562b6fda-880b-4921-a136-b2448ee45110 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Calling method '.version_select at 0x7f3e76c75700>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:46.256254 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-562b6fda-880b-4921-a136-b2448ee45110 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] HTTP exception thrown: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-562b6fda-880b-4921-a136-b2448ee45110 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Request method failure captured: May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/os-volumes/ea9df00b-fc5b-4b01-ae6b-d3946fbd775e HTTP/1.1 May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqR9Pu9ai4-tJvRyOczOA5RqIvdq7CEJC0MFvLxc8bLBCElvRKbXl-ExIgZh_pV43s1dzprQHM_8mZM2mzAKa299O6kCBMn7iNdFG9hIb4DIBHIyet6PCRk3YKS7KT5u3UPO3UWHzaWpDJy2aOsVLR6AlPaTfHcv1J9ctx2M9CvXYFQ May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: 39a2edf9ed6b480a9863609f51689013 May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-10272551 May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:44:46.259607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:44:46.260762 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/39a2edf9ed6b480a9863609f51689013"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/39a2edf9ed6b480a9863609f51689013"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_39a2edf9ed6b480a9863609f51689013"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/39a2edf9ed6b480a9863609f51689013"}]}] May 10 17:44:46.260762 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-VolumesSnapshotsTestJSON-10272551 May 10 17:44:46.260762 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 39a2edf9ed6b480a9863609f51689013 May 10 17:44:46.260762 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-10272551 May 10 17:44:46.260762 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-VolumesSnapshotsTestJSON-10272551-project May 10 17:44:46.260762 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:44:46.260762 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:44:46.260762 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: 99eceaf1a3984d189ace4ce96827867c May 10 17:44:46.260762 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-VolumesSnapshotsTestJSON-10272551-project May 10 17:44:46.260762 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: May 10 17:44:46.260762 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. May 10 17:44:46.260762 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': 'ea9df00b-fc5b-4b01-ae6b-d3946fbd775e'} May 10 17:44:46.260762 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:44:46.261385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:44:46.261385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 17:44:46.261385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 17:44:46.261385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 17:44:46.261385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 17:44:46.261385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 17:44:46.261385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 17:44:46.261385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 17:44:46.261385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 17:44:46.261385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 17:44:46.261385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 17:44:46.261385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 17:44:46.261385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 17:44:46.261385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 17:44:46.261385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 17:44:46.261385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. (HTTP 404) (Request-ID: req-249e5397-f509-48fd-be7d-f352a9db54c7) May 10 17:44:46.261385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:44:46.261385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:44:46.261385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:44:46.262345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:44:46.262345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 17:44:46.262345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 17:44:46.262345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 17:44:46.262345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 17:44:46.262345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 17:44:46.262345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 17:44:46.262345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 17:44:46.262345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 17:44:46.262345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 17:44:46.262345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 17:44:46.262345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 17:44:46.262345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 17:44:46.262345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 17:44:46.262345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 17:44:46.262345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 17:44:46.262345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 17:44:46.262345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 17:44:46.262345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 17:44:46.263191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 17:44:46.263191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 17:44:46.263191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 17:44:46.263191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 17:44:46.263191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. May 10 17:44:46.263191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:44:46.263191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:44:46.263191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:44:46.263191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:44:46.263191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:44:46.263191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:44:46.263191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:44:46.263191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:44:46.263191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 17:44:46.263191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 17:44:46.263191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:44:46.263191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:44:46.263191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 17:44:46.263191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:44:46.264090 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. May 10 17:44:46.264090 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:44:46.264090 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:44:46.264090 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:44:46.264090 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:44:46.264090 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:44:46.264090 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:44:46.264090 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:44:46.264090 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:44:46.264090 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. May 10 17:44:46.264090 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:44:46.266235 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-562b6fda-880b-4921-a136-b2448ee45110 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] Returning 404 to user: Volume ea9df00b-fc5b-4b01-ae6b-d3946fbd775e could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:44:46.267284 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-562b6fda-880b-4921-a136-b2448ee45110 tempest-VolumesSnapshotsTestJSON-10272551 tempest-VolumesSnapshotsTestJSON-10272551-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/ea9df00b-fc5b-4b01-ae6b-d3946fbd775e" status: 404 len: 109 microversion: 2.1 time: 0.116814 May 10 17:44:46.268415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 10/30] 10.222.0.60 () {58 vars in 1244 bytes} [Tue May 10 17:44:46 2022] GET /compute/v2.1/os-volumes/ea9df00b-fc5b-4b01-ae6b-d3946fbd775e => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:44:46.970064 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-982ad5e6-d489-44b4-b520-077a4b005fd4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:46.970976 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-982ad5e6-d489-44b4-b520-077a4b005fd4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:47.000314 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-982ad5e6-d489-44b4-b520-077a4b005fd4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:47.000803 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-982ad5e6-d489-44b4-b520-077a4b005fd4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:47.003044 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-982ad5e6-d489-44b4-b520-077a4b005fd4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:47.004699 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-982ad5e6-d489-44b4-b520-077a4b005fd4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:47.322404 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-982ad5e6-d489-44b4-b520-077a4b005fd4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:44:47.338266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-982ad5e6-d489-44b4-b520-077a4b005fd4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1273 microversion: 2.1 time: 0.372534 May 10 17:44:47.346546 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 11/31] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:46 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1273 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:44:47.566506 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-52c3a08b-063b-4899-a303-65023b66545e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1717085125", "imageRef": "a7737c62-8029-44aa-8da7-e46fea7607fb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:44:47.835480 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-45e649ec-e588-4ec7-ba64-d4943c703876 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Action: 'create', calling method: .version_select at 0x7f3e76c75280>, body: {"keypair": {"name": "tempest-keypair-93431245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLEGTWN4vgdRKhIx0OoMmrYxVcCRaNj6hECBWV56Bj0JK4VYmaRGSjlb+xvtLT40K841vttO1upF6Oswxhi7xXvEQ9vuN9sHvoPaaA2frUd74Ie3+5to61Nl6Zh+78FUSQ=="}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:44:47.858939 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.network.neutron [None req-52c3a08b-063b-4899-a303-65023b66545e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] validate_networks() for [('f37a5a11-05c8-4d32-b0a0-13874a53c216', None, None, None, None, None)] {{(pid=123753) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:44:47.910805 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-45e649ec-e588-4ec7-ba64-d4943c703876 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Getting quotas for project f4e017a4040d450aad862065563ea64d. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:44:47.943607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-45e649ec-e588-4ec7-ba64-d4943c703876 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Getting quotas for user e6a99e5d684a48a2845d3379e7df812c and project f4e017a4040d450aad862065563ea64d. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:44:48.020981 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-45e649ec-e588-4ec7-ba64-d4943c703876 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.672214 May 10 17:44:48.030884 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 12/32] 10.222.0.60 () {60 vars in 1158 bytes} [Tue May 10 17:44:47 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:44:48.363399 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-be427fde-6305-42c9-817f-dce1cafe40d2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:48.364114 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-be427fde-6305-42c9-817f-dce1cafe40d2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:48.374221 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-be427fde-6305-42c9-817f-dce1cafe40d2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:48.376099 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-be427fde-6305-42c9-817f-dce1cafe40d2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:48.378544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-be427fde-6305-42c9-817f-dce1cafe40d2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:48.380074 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-be427fde-6305-42c9-817f-dce1cafe40d2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:49.944960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-be427fde-6305-42c9-817f-dce1cafe40d2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:44:49.972670 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-be427fde-6305-42c9-817f-dce1cafe40d2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 1.612075 May 10 17:44:49.973725 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 13/33] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:48 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:44:50.990347 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1dbcfb68-97dc-4043-a499-6cad7da4612f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:50.990974 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1dbcfb68-97dc-4043-a499-6cad7da4612f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:51.015580 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1dbcfb68-97dc-4043-a499-6cad7da4612f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:51.016040 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1dbcfb68-97dc-4043-a499-6cad7da4612f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:51.016883 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1dbcfb68-97dc-4043-a499-6cad7da4612f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:51.025784 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1dbcfb68-97dc-4043-a499-6cad7da4612f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:51.117360 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-52c3a08b-063b-4899-a303-65023b66545e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Flavor limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:44:51.119087 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-52c3a08b-063b-4899-a303-65023b66545e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Image limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:44:51.123459 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-52c3a08b-063b-4899-a303-65023b66545e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Flavor pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:44:51.124611 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-52c3a08b-063b-4899-a303-65023b66545e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Image pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:44:51.125783 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-52c3a08b-063b-4899-a303-65023b66545e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:44:51.172791 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-52c3a08b-063b-4899-a303-65023b66545e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:51.173244 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-52c3a08b-063b-4899-a303-65023b66545e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:51.175276 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-52c3a08b-063b-4899-a303-65023b66545e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:51.175783 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-52c3a08b-063b-4899-a303-65023b66545e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:51.252674 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-52c3a08b-063b-4899-a303-65023b66545e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Getting quotas for project ec9da2f35bcd444fa485c453103df5cc. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:44:51.275908 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-52c3a08b-063b-4899-a303-65023b66545e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Getting quotas for user 93f2755bf7ac430f9380bf2cf3ecb97f and project ec9da2f35bcd444fa485c453103df5cc. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:44:51.326305 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-52c3a08b-063b-4899-a303-65023b66545e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Going to run 1 instances... {{(pid=123753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:44:51.331017 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-52c3a08b-063b-4899-a303-65023b66545e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7737c62-8029-44aa-8da7-e46fea7607fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:44:51.501166 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1dbcfb68-97dc-4043-a499-6cad7da4612f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:44:51.521125 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1dbcfb68-97dc-4043-a499-6cad7da4612f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 0.532475 May 10 17:44:51.525112 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 14/34] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:50 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:44:51.672946 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-52c3a08b-063b-4899-a303-65023b66545e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.280674 May 10 17:44:51.674659 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 21/35] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 17:44:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 5285 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:44:51.694772 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8c4ce66c-c5d6-41b0-beba-af4927ef54ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:51.700416 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8c4ce66c-c5d6-41b0-beba-af4927ef54ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:51.922125 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8c4ce66c-c5d6-41b0-beba-af4927ef54ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:44:51.931783 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8c4ce66c-c5d6-41b0-beba-af4927ef54ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1222 microversion: 2.1 time: 0.248765 May 10 17:44:51.933418 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 15/36] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:51 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1222 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:44:52.195206 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ef7ea5c0-aada-4fb3-be20-7730c79e765a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1713225356", "imageRef": "a7737c62-8029-44aa-8da7-e46fea7607fb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:44:52.339142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.network.neutron [None req-ef7ea5c0-aada-4fb3-be20-7730c79e765a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] validate_networks() for [('f37a5a11-05c8-4d32-b0a0-13874a53c216', None, None, None, None, None)] {{(pid=123753) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:44:52.541350 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9be35360-1e33-4f5b-adbd-9dd7311004ef tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:52.542778 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9be35360-1e33-4f5b-adbd-9dd7311004ef tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:52.570242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9be35360-1e33-4f5b-adbd-9dd7311004ef tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:52.575026 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9be35360-1e33-4f5b-adbd-9dd7311004ef tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:52.583154 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9be35360-1e33-4f5b-adbd-9dd7311004ef tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:52.592026 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9be35360-1e33-4f5b-adbd-9dd7311004ef tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:53.315767 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9be35360-1e33-4f5b-adbd-9dd7311004ef tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:44:53.333735 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9be35360-1e33-4f5b-adbd-9dd7311004ef tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 0.797788 May 10 17:44:53.334324 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 16/37] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:52 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:44:53.814600 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-ef7ea5c0-aada-4fb3-be20-7730c79e765a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Flavor limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:44:53.815095 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-ef7ea5c0-aada-4fb3-be20-7730c79e765a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Image limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:44:53.815600 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-ef7ea5c0-aada-4fb3-be20-7730c79e765a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Flavor pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:44:53.816005 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-ef7ea5c0-aada-4fb3-be20-7730c79e765a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Image pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:44:53.816424 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-ef7ea5c0-aada-4fb3-be20-7730c79e765a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:44:53.834503 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ef7ea5c0-aada-4fb3-be20-7730c79e765a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:53.834963 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ef7ea5c0-aada-4fb3-be20-7730c79e765a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:53.835791 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ef7ea5c0-aada-4fb3-be20-7730c79e765a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:53.845570 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ef7ea5c0-aada-4fb3-be20-7730c79e765a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:53.948066 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-ef7ea5c0-aada-4fb3-be20-7730c79e765a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Getting quotas for project ec9da2f35bcd444fa485c453103df5cc. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:44:53.975471 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-ef7ea5c0-aada-4fb3-be20-7730c79e765a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Getting quotas for user 93f2755bf7ac430f9380bf2cf3ecb97f and project ec9da2f35bcd444fa485c453103df5cc. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:44:54.068066 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ef7ea5c0-aada-4fb3-be20-7730c79e765a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Going to run 1 instances... {{(pid=123753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:44:54.093542 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ef7ea5c0-aada-4fb3-be20-7730c79e765a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7737c62-8029-44aa-8da7-e46fea7607fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:44:54.227496 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ef7ea5c0-aada-4fb3-be20-7730c79e765a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.031988 May 10 17:44:54.231507 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 22/38] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 17:44:52 2022] POST /compute/v2.1/servers => generated 383 bytes in 2043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:44:54.240940 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f4276e14-cb2d-4a57-9699-742302d097bc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:54.242219 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f4276e14-cb2d-4a57-9699-742302d097bc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:54.355801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-80469c9c-4b27-4bd6-9bb1-63535471945f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:54.356823 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-80469c9c-4b27-4bd6-9bb1-63535471945f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:54.379841 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-80469c9c-4b27-4bd6-9bb1-63535471945f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:54.380758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-80469c9c-4b27-4bd6-9bb1-63535471945f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:54.388899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-80469c9c-4b27-4bd6-9bb1-63535471945f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:54.389856 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-80469c9c-4b27-4bd6-9bb1-63535471945f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:54.517872 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f4276e14-cb2d-4a57-9699-742302d097bc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:44:54.527517 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f4276e14-cb2d-4a57-9699-742302d097bc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1222 microversion: 2.1 time: 0.291181 May 10 17:44:54.532036 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 17/39] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:54 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1222 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:44:54.901511 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-80469c9c-4b27-4bd6-9bb1-63535471945f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:44:54.919996 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-80469c9c-4b27-4bd6-9bb1-63535471945f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 0.568493 May 10 17:44:54.930666 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 23/40] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:54 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:44:55.550418 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-eefe9141-a151-445b-86d9-adee0b50cba7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:55.556206 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-eefe9141-a151-445b-86d9-adee0b50cba7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:55.793849 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-eefe9141-a151-445b-86d9-adee0b50cba7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:44:55.806043 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-eefe9141-a151-445b-86d9-adee0b50cba7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1222 microversion: 2.1 time: 0.261545 May 10 17:44:55.824043 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 18/41] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:55 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1222 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:44:55.939075 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-d8aad3d5-0467-4793-93a3-428c4fd6021f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:55.943657 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-d8aad3d5-0467-4793-93a3-428c4fd6021f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:55.961209 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d8aad3d5-0467-4793-93a3-428c4fd6021f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:55.961814 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d8aad3d5-0467-4793-93a3-428c4fd6021f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:55.962638 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d8aad3d5-0467-4793-93a3-428c4fd6021f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:55.963087 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d8aad3d5-0467-4793-93a3-428c4fd6021f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:56.825646 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-976bdb04-536c-43cc-9039-6b6ad9b9fc16 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:56.842265 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-976bdb04-536c-43cc-9039-6b6ad9b9fc16 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:56.860846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-976bdb04-536c-43cc-9039-6b6ad9b9fc16 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:56.870568 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-976bdb04-536c-43cc-9039-6b6ad9b9fc16 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:56.873492 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-976bdb04-536c-43cc-9039-6b6ad9b9fc16 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:56.876272 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-976bdb04-536c-43cc-9039-6b6ad9b9fc16 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:57.098924 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-d8aad3d5-0467-4793-93a3-428c4fd6021f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:44:57.122373 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-d8aad3d5-0467-4793-93a3-428c4fd6021f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 1.187081 May 10 17:44:57.139563 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 24/42] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:55 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 1205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:44:57.523518 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-976bdb04-536c-43cc-9039-6b6ad9b9fc16 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:44:57.545252 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-976bdb04-536c-43cc-9039-6b6ad9b9fc16 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1274 microversion: 2.1 time: 0.719336 May 10 17:44:57.546159 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 19/43] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:56 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1274 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:44:58.004257 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-9120d62f-3e3b-4097-9d56-179cdcf34a8e req-dae99ef3-010a-404a-b05f-69b38870b5ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd7903d-232c-4666-939c-eb22c6fbf01b", "tag": "dee56dfb-cae2-41f9-b79a-5dd4e4a84d7f"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:44:58.038264 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-9120d62f-3e3b-4097-9d56-179cdcf34a8e req-dae99ef3-010a-404a-b05f-69b38870b5ad service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:58.040569 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-9120d62f-3e3b-4097-9d56-179cdcf34a8e req-dae99ef3-010a-404a-b05f-69b38870b5ad service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:58.105766 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-9120d62f-3e3b-4097-9d56-179cdcf34a8e req-dae99ef3-010a-404a-b05f-69b38870b5ad service nova] Creating event network-changed:dee56dfb-cae2-41f9-b79a-5dd4e4a84d7f for instance acd7903d-232c-4666-939c-eb22c6fbf01b on hv-cinder-84130 May 10 17:44:58.108058 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-9120d62f-3e3b-4097-9d56-179cdcf34a8e req-dae99ef3-010a-404a-b05f-69b38870b5ad service nova] Acquired lock "compute-rpcapi-router" {{(pid=123753) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 17:44:58.113843 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b3908aa4-0f94-4337-bff9-ad3d333b6279 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:58.118010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b3908aa4-0f94-4337-bff9-ad3d333b6279 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:58.126312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b3908aa4-0f94-4337-bff9-ad3d333b6279 None None] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:58.127856 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b3908aa4-0f94-4337-bff9-ad3d333b6279 None None] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:58.139785 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8f8562d7-3b9d-497d-9b7e-06708287cf11 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:58.140610 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8f8562d7-3b9d-497d-9b7e-06708287cf11 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:58.149980 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8f8562d7-3b9d-497d-9b7e-06708287cf11 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:58.154150 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.compute.rpcapi [None req-b3908aa4-0f94-4337-bff9-ad3d333b6279 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 17:44:58.159228 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b3908aa4-0f94-4337-bff9-ad3d333b6279 None None] Releasing lock "compute-rpcapi-router" {{(pid=123753) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 17:44:58.159992 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8f8562d7-3b9d-497d-9b7e-06708287cf11 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:58.160951 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8f8562d7-3b9d-497d-9b7e-06708287cf11 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:58.162225 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8f8562d7-3b9d-497d-9b7e-06708287cf11 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:58.228933 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b3908aa4-0f94-4337-bff9-ad3d333b6279 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.458414 May 10 17:44:58.233266 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 25/44] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:44:58.568697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-02753a20-ad2d-4581-9a2e-7b2b8dbb67cc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:58.569635 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-02753a20-ad2d-4581-9a2e-7b2b8dbb67cc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:58.603164 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-02753a20-ad2d-4581-9a2e-7b2b8dbb67cc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:58.605387 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-02753a20-ad2d-4581-9a2e-7b2b8dbb67cc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:58.609546 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-02753a20-ad2d-4581-9a2e-7b2b8dbb67cc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:58.610694 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-02753a20-ad2d-4581-9a2e-7b2b8dbb67cc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:58.894425 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-02753a20-ad2d-4581-9a2e-7b2b8dbb67cc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:44:58.907323 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-02753a20-ad2d-4581-9a2e-7b2b8dbb67cc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1280 microversion: 2.1 time: 0.347156 May 10 17:44:58.911196 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 26/45] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:58 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1280 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:44:58.951460 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8f8562d7-3b9d-497d-9b7e-06708287cf11 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:44:58.960810 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8f8562d7-3b9d-497d-9b7e-06708287cf11 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 0.824772 May 10 17:44:58.970571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 20/46] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:58 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:44:59.416250 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8720eff2-8eea-44b1-b6ab-7d86cab5c101 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-105456440", "imageRef": "a7737c62-8029-44aa-8da7-e46fea7607fb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4f6007aa-61b1-40c3-a8ad-7f431d419cb5"}], "security_groups": [{"name": "tempest-securitygroup--1616844650"}], "key_name": "tempest-keypair-1037564527", "user_data": "}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:44:59.926225 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-17eeaf2d-1808-4c73-bef3-1d404d6cb35a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:44:59.926829 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-17eeaf2d-1808-4c73-bef3-1d404d6cb35a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:44:59.946401 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-17eeaf2d-1808-4c73-bef3-1d404d6cb35a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:59.946401 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-17eeaf2d-1808-4c73-bef3-1d404d6cb35a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:44:59.947848 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-17eeaf2d-1808-4c73-bef3-1d404d6cb35a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:44:59.948289 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-17eeaf2d-1808-4c73-bef3-1d404d6cb35a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:00.009697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.network.neutron [None req-8720eff2-8eea-44b1-b6ab-7d86cab5c101 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] validate_networks() for [('4f6007aa-61b1-40c3-a8ad-7f431d419cb5', None, None, None, None, None)] {{(pid=123753) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:45:00.477955 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-17eeaf2d-1808-4c73-bef3-1d404d6cb35a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:00.489050 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-17eeaf2d-1808-4c73-bef3-1d404d6cb35a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1280 microversion: 2.1 time: 0.566671 May 10 17:45:00.492032 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 21/47] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:44:59 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1280 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:00.501686 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-86ef3c73-5ede-4e21-9109-a1a560774e5e tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:00.522259 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-86ef3c73-5ede-4e21-9109-a1a560774e5e tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:00.566000 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-86ef3c73-5ede-4e21-9109-a1a560774e5e tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:00.566692 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-86ef3c73-5ede-4e21-9109-a1a560774e5e tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:00.567621 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-86ef3c73-5ede-4e21-9109-a1a560774e5e tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:00.568117 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-86ef3c73-5ede-4e21-9109-a1a560774e5e tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:01.479219 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-86ef3c73-5ede-4e21-9109-a1a560774e5e tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:01.490306 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-86ef3c73-5ede-4e21-9109-a1a560774e5e tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 0.993256 May 10 17:45:01.491046 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 22/48] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:00 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:01.511123 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-55a0152b-bbec-43ee-ac23-d11d5cfa7c0f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:01.519506 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-55a0152b-bbec-43ee-ac23-d11d5cfa7c0f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:01.546627 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55a0152b-bbec-43ee-ac23-d11d5cfa7c0f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:01.547526 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55a0152b-bbec-43ee-ac23-d11d5cfa7c0f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:01.549044 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55a0152b-bbec-43ee-ac23-d11d5cfa7c0f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:01.549711 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55a0152b-bbec-43ee-ac23-d11d5cfa7c0f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:01.812481 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-55a0152b-bbec-43ee-ac23-d11d5cfa7c0f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:01.828492 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-55a0152b-bbec-43ee-ac23-d11d5cfa7c0f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1280 microversion: 2.1 time: 0.314090 May 10 17:45:01.829262 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 23/49] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:01 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1280 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:02.196722 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4afb7c69-3035-457c-95e7-5a7c79f26f2e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-558358036", "imageRef": "a7737c62-8029-44aa-8da7-e46fea7607fb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a13d84d-c9e9-413f-a254-ca6edab95c78"}], "security_groups": [{"name": "tempest-securitygroup--627379976"}], "key_name": "tempest-keypair-93431245", "user_data": "}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:45:02.527685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-8720eff2-8eea-44b1-b6ab-7d86cab5c101 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Flavor limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:45:02.528930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-8720eff2-8eea-44b1-b6ab-7d86cab5c101 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Image limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:45:02.529560 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-8720eff2-8eea-44b1-b6ab-7d86cab5c101 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Flavor pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:45:02.530127 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-8720eff2-8eea-44b1-b6ab-7d86cab5c101 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Image pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:45:02.530809 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-8720eff2-8eea-44b1-b6ab-7d86cab5c101 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:45:02.550581 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8720eff2-8eea-44b1-b6ab-7d86cab5c101 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:02.556223 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8720eff2-8eea-44b1-b6ab-7d86cab5c101 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:02.557534 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8720eff2-8eea-44b1-b6ab-7d86cab5c101 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:02.558030 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8720eff2-8eea-44b1-b6ab-7d86cab5c101 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:02.637703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-8720eff2-8eea-44b1-b6ab-7d86cab5c101 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Getting quotas for project 0461acfadf8743fdbd62a39bf3fe3e1c. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:45:02.652427 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-8720eff2-8eea-44b1-b6ab-7d86cab5c101 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Getting quotas for user ed37128b78a6454c9c387ad91995a05d and project 0461acfadf8743fdbd62a39bf3fe3e1c. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:45:02.680104 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8720eff2-8eea-44b1-b6ab-7d86cab5c101 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Going to run 1 instances... {{(pid=123753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:45:02.688825 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8720eff2-8eea-44b1-b6ab-7d86cab5c101 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7737c62-8029-44aa-8da7-e46fea7607fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:45:02.762148 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8720eff2-8eea-44b1-b6ab-7d86cab5c101 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.355892 May 10 17:45:02.763398 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 27/50] 10.222.0.60 () {62 vars in 1187 bytes} [Tue May 10 17:44:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 3358 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 17:45:02.768679 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e5928345-c4d9-49c0-8f8f-4417cb04b204 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:02.769494 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e5928345-c4d9-49c0-8f8f-4417cb04b204 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:02.784886 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e5928345-c4d9-49c0-8f8f-4417cb04b204 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:02.786271 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e5928345-c4d9-49c0-8f8f-4417cb04b204 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:02.787999 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e5928345-c4d9-49c0-8f8f-4417cb04b204 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:02.788469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e5928345-c4d9-49c0-8f8f-4417cb04b204 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:02.801452 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-4afb7c69-3035-457c-95e7-5a7c79f26f2e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] validate_networks() for [('5a13d84d-c9e9-413f-a254-ca6edab95c78', None, None, None, None, None)] {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:45:03.493929 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e5928345-c4d9-49c0-8f8f-4417cb04b204 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:03.504870 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e5928345-c4d9-49c0-8f8f-4417cb04b204 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 0.737919 May 10 17:45:03.507548 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 28/51] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:02 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:03.532299 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7a5e6df7-b6ce-47a8-ae64-c76c45c289a7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:03.532933 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7a5e6df7-b6ce-47a8-ae64-c76c45c289a7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:03.709744 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7a5e6df7-b6ce-47a8-ae64-c76c45c289a7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:03.728695 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7a5e6df7-b6ce-47a8-ae64-c76c45c289a7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:03.730825 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7a5e6df7-b6ce-47a8-ae64-c76c45c289a7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:03.732329 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7a5e6df7-b6ce-47a8-ae64-c76c45c289a7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1281 microversion: 2.20 time: 0.212119 May 10 17:45:03.744937 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 29/52] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:03 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1281 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:03.750815 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-3a49fa32-bee2-4980-a56f-3845bc52d83a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:03.751783 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-3a49fa32-bee2-4980-a56f-3845bc52d83a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:03.761431 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3a49fa32-bee2-4980-a56f-3845bc52d83a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:03.762223 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3a49fa32-bee2-4980-a56f-3845bc52d83a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:03.763347 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3a49fa32-bee2-4980-a56f-3845bc52d83a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:03.764136 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3a49fa32-bee2-4980-a56f-3845bc52d83a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:03.992832 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-4afb7c69-3035-457c-95e7-5a7c79f26f2e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:45:03.993343 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-4afb7c69-3035-457c-95e7-5a7c79f26f2e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:45:03.993726 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-4afb7c69-3035-457c-95e7-5a7c79f26f2e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:45:03.994140 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-4afb7c69-3035-457c-95e7-5a7c79f26f2e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:45:03.994554 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-4afb7c69-3035-457c-95e7-5a7c79f26f2e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:45:04.024153 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4afb7c69-3035-457c-95e7-5a7c79f26f2e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:04.027716 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4afb7c69-3035-457c-95e7-5a7c79f26f2e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:04.030661 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4afb7c69-3035-457c-95e7-5a7c79f26f2e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:04.033198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4afb7c69-3035-457c-95e7-5a7c79f26f2e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:04.035725 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-3a49fa32-bee2-4980-a56f-3845bc52d83a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:04.045394 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-3a49fa32-bee2-4980-a56f-3845bc52d83a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.298933 May 10 17:45:04.046162 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 30/53] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:03 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:04.081056 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-4afb7c69-3035-457c-95e7-5a7c79f26f2e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Getting quotas for project f4e017a4040d450aad862065563ea64d. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:45:04.086856 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-4afb7c69-3035-457c-95e7-5a7c79f26f2e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Getting quotas for user e6a99e5d684a48a2845d3379e7df812c and project f4e017a4040d450aad862065563ea64d. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:45:04.106575 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4afb7c69-3035-457c-95e7-5a7c79f26f2e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:45:04.110731 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4afb7c69-3035-457c-95e7-5a7c79f26f2e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7737c62-8029-44aa-8da7-e46fea7607fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:45:04.236729 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4afb7c69-3035-457c-95e7-5a7c79f26f2e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.042183 May 10 17:45:04.242620 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 24/54] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 17:45:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 2050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 17:45:04.305203 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-49446d80-1be8-4294-bd3f-0ebb3f268eee req-f2e4e8a8-6f42-4c6a-8d94-79b134e9a34d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1bf8bc9-b3de-4555-8835-15dd3a89bc56", "tag": "552e62e9-0e95-4838-9c01-aa3425c6c9c6"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:45:04.318137 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-53b65260-e888-4c2f-bdec-0d369445f1a4 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:04.322236 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-53b65260-e888-4c2f-bdec-0d369445f1a4 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:04.368468 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-49446d80-1be8-4294-bd3f-0ebb3f268eee req-f2e4e8a8-6f42-4c6a-8d94-79b134e9a34d service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:04.372920 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-49446d80-1be8-4294-bd3f-0ebb3f268eee req-f2e4e8a8-6f42-4c6a-8d94-79b134e9a34d service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:04.415384 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-49446d80-1be8-4294-bd3f-0ebb3f268eee req-f2e4e8a8-6f42-4c6a-8d94-79b134e9a34d service nova] Creating event network-changed:552e62e9-0e95-4838-9c01-aa3425c6c9c6 for instance c1bf8bc9-b3de-4555-8835-15dd3a89bc56 on hv-cinder-84130 May 10 17:45:04.436380 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-49446d80-1be8-4294-bd3f-0ebb3f268eee req-f2e4e8a8-6f42-4c6a-8d94-79b134e9a34d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.377847 May 10 17:45:04.439868 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 31/55] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:45:04.486047 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-53b65260-e888-4c2f-bdec-0d369445f1a4 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:04.496514 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-53b65260-e888-4c2f-bdec-0d369445f1a4 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1239 microversion: 2.1 time: 0.247624 May 10 17:45:04.500867 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 25/56] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:04 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1239 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:04.526299 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-934b4851-a5cc-411c-8207-71a26cb0b108 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:04.526927 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-934b4851-a5cc-411c-8207-71a26cb0b108 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:04.545732 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-934b4851-a5cc-411c-8207-71a26cb0b108 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:04.545732 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-934b4851-a5cc-411c-8207-71a26cb0b108 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:04.557887 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-934b4851-a5cc-411c-8207-71a26cb0b108 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:04.558607 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-934b4851-a5cc-411c-8207-71a26cb0b108 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:04.756830 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e3ab4dcf-5bc6-4bbd-8a65-34d93f1f4645 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:04.758651 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e3ab4dcf-5bc6-4bbd-8a65-34d93f1f4645 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:04.770627 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3ab4dcf-5bc6-4bbd-8a65-34d93f1f4645 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:04.771529 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3ab4dcf-5bc6-4bbd-8a65-34d93f1f4645 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:04.773011 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3ab4dcf-5bc6-4bbd-8a65-34d93f1f4645 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:04.774612 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3ab4dcf-5bc6-4bbd-8a65-34d93f1f4645 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:04.924375 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e3ab4dcf-5bc6-4bbd-8a65-34d93f1f4645 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:04.934681 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e3ab4dcf-5bc6-4bbd-8a65-34d93f1f4645 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:04.939997 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e3ab4dcf-5bc6-4bbd-8a65-34d93f1f4645 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:04.944174 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e3ab4dcf-5bc6-4bbd-8a65-34d93f1f4645 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1285 microversion: 2.20 time: 0.196086 May 10 17:45:04.959537 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 26/57] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:04 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1285 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:04.965627 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-5c90646f-9201-4213-8749-a092a4b1100e req-373f1a43-f26c-49b9-a304-c77c37d1ffed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d577a65c-d60c-4d64-a506-89ea984fe255", "tag": "bc6ac4c5-c4f8-4e9e-abbf-8071b383eb36"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:45:04.986998 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-5c90646f-9201-4213-8749-a092a4b1100e req-373f1a43-f26c-49b9-a304-c77c37d1ffed service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:04.987833 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-5c90646f-9201-4213-8749-a092a4b1100e req-373f1a43-f26c-49b9-a304-c77c37d1ffed service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:04.998361 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-934b4851-a5cc-411c-8207-71a26cb0b108 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:05.006824 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-934b4851-a5cc-411c-8207-71a26cb0b108 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 0.485706 May 10 17:45:05.007443 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 32/58] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:04 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:05.014137 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-5c90646f-9201-4213-8749-a092a4b1100e req-373f1a43-f26c-49b9-a304-c77c37d1ffed service nova] Creating event network-changed:bc6ac4c5-c4f8-4e9e-abbf-8071b383eb36 for instance d577a65c-d60c-4d64-a506-89ea984fe255 on hv-cinder-84130 May 10 17:45:05.014799 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-5c90646f-9201-4213-8749-a092a4b1100e req-373f1a43-f26c-49b9-a304-c77c37d1ffed service nova] Acquired lock "compute-rpcapi-router" {{(pid=123752) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 10 17:45:05.016065 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-430a81c5-1117-47b8-aa0b-ba197b512790 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:05.016598 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-430a81c5-1117-47b8-aa0b-ba197b512790 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:05.017652 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-430a81c5-1117-47b8-aa0b-ba197b512790 None None] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:05.018514 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-430a81c5-1117-47b8-aa0b-ba197b512790 None None] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:05.028611 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.compute.rpcapi [None req-430a81c5-1117-47b8-aa0b-ba197b512790 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 10 17:45:05.029732 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-430a81c5-1117-47b8-aa0b-ba197b512790 None None] Releasing lock "compute-rpcapi-router" {{(pid=123752) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 10 17:45:05.055243 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-430a81c5-1117-47b8-aa0b-ba197b512790 None None] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092861 May 10 17:45:05.056076 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 27/59] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:45:05.064109 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e77dcaf4-9636-4833-8cd9-acb1eeb4e594 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:05.064795 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e77dcaf4-9636-4833-8cd9-acb1eeb4e594 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:05.083590 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e77dcaf4-9636-4833-8cd9-acb1eeb4e594 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:05.084062 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e77dcaf4-9636-4833-8cd9-acb1eeb4e594 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:05.086248 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e77dcaf4-9636-4833-8cd9-acb1eeb4e594 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:05.086563 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e77dcaf4-9636-4833-8cd9-acb1eeb4e594 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:05.291547 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e77dcaf4-9636-4833-8cd9-acb1eeb4e594 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:05.299152 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e77dcaf4-9636-4833-8cd9-acb1eeb4e594 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.240040 May 10 17:45:05.299871 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 33/60] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:05 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:05.518222 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d30ee3bc-d62b-4329-a870-a00a6f6e572e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:05.519670 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d30ee3bc-d62b-4329-a870-a00a6f6e572e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:05.535529 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d30ee3bc-d62b-4329-a870-a00a6f6e572e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:05.536138 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d30ee3bc-d62b-4329-a870-a00a6f6e572e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:05.537065 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d30ee3bc-d62b-4329-a870-a00a6f6e572e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:05.537613 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d30ee3bc-d62b-4329-a870-a00a6f6e572e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:05.628819 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d30ee3bc-d62b-4329-a870-a00a6f6e572e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:05.641511 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d30ee3bc-d62b-4329-a870-a00a6f6e572e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1243 microversion: 2.1 time: 0.127255 May 10 17:45:05.642856 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 28/61] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:05 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1243 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:05.963744 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e9eccd77-f687-4900-8bd2-df8f2f861370 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:05.964364 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e9eccd77-f687-4900-8bd2-df8f2f861370 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:05.971151 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e9eccd77-f687-4900-8bd2-df8f2f861370 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:05.971640 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e9eccd77-f687-4900-8bd2-df8f2f861370 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:05.972451 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e9eccd77-f687-4900-8bd2-df8f2f861370 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:05.972905 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e9eccd77-f687-4900-8bd2-df8f2f861370 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:06.029358 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f894dccc-ddac-4345-b71c-c208ba025ef4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:06.030737 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f894dccc-ddac-4345-b71c-c208ba025ef4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:06.038365 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f894dccc-ddac-4345-b71c-c208ba025ef4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:06.039217 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f894dccc-ddac-4345-b71c-c208ba025ef4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:06.040068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f894dccc-ddac-4345-b71c-c208ba025ef4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:06.040697 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f894dccc-ddac-4345-b71c-c208ba025ef4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:06.041134 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e9eccd77-f687-4900-8bd2-df8f2f861370 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:06.052635 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e9eccd77-f687-4900-8bd2-df8f2f861370 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:06.054234 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e9eccd77-f687-4900-8bd2-df8f2f861370 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:06.056081 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e9eccd77-f687-4900-8bd2-df8f2f861370 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1285 microversion: 2.20 time: 0.096179 May 10 17:45:06.068135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 34/62] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:05 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:06.188243 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f894dccc-ddac-4345-b71c-c208ba025ef4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:06.196384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f894dccc-ddac-4345-b71c-c208ba025ef4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 0.176116 May 10 17:45:06.206158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 29/63] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:06 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:06.316403 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fa44d081-b044-44dc-9e7a-fee4393651ec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:06.317066 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-fa44d081-b044-44dc-9e7a-fee4393651ec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:06.325388 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fa44d081-b044-44dc-9e7a-fee4393651ec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:06.325855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fa44d081-b044-44dc-9e7a-fee4393651ec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:06.326633 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fa44d081-b044-44dc-9e7a-fee4393651ec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:06.327080 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fa44d081-b044-44dc-9e7a-fee4393651ec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:06.468952 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fa44d081-b044-44dc-9e7a-fee4393651ec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:06.476368 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-fa44d081-b044-44dc-9e7a-fee4393651ec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.163746 May 10 17:45:06.477532 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 35/64] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:06 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:06.669586 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3117f16d-25ed-4293-ba46-24223127dd86 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:06.670580 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3117f16d-25ed-4293-ba46-24223127dd86 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:06.676917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3117f16d-25ed-4293-ba46-24223127dd86 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:06.677364 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3117f16d-25ed-4293-ba46-24223127dd86 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:06.678134 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3117f16d-25ed-4293-ba46-24223127dd86 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:06.678683 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3117f16d-25ed-4293-ba46-24223127dd86 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:06.751687 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3117f16d-25ed-4293-ba46-24223127dd86 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:06.759952 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3117f16d-25ed-4293-ba46-24223127dd86 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1243 microversion: 2.1 time: 0.094072 May 10 17:45:06.760538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 30/65] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:06 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1243 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:07.074671 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f5f95dba-6968-426a-8004-89b30af95ca7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:07.076122 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f5f95dba-6968-426a-8004-89b30af95ca7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:07.083035 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f5f95dba-6968-426a-8004-89b30af95ca7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:07.083604 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f5f95dba-6968-426a-8004-89b30af95ca7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:07.084590 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f5f95dba-6968-426a-8004-89b30af95ca7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:07.085100 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f5f95dba-6968-426a-8004-89b30af95ca7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:07.159198 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f5f95dba-6968-426a-8004-89b30af95ca7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:07.168129 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f5f95dba-6968-426a-8004-89b30af95ca7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:07.170045 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f5f95dba-6968-426a-8004-89b30af95ca7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:07.171339 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f5f95dba-6968-426a-8004-89b30af95ca7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1285 microversion: 2.20 time: 0.101386 May 10 17:45:07.172396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 36/66] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:07 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:07.214403 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3f82e35b-0281-4ca9-b64f-36db76cbdb6f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:07.215320 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3f82e35b-0281-4ca9-b64f-36db76cbdb6f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:07.221178 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3f82e35b-0281-4ca9-b64f-36db76cbdb6f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:07.221633 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3f82e35b-0281-4ca9-b64f-36db76cbdb6f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:07.222395 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3f82e35b-0281-4ca9-b64f-36db76cbdb6f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:07.222831 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3f82e35b-0281-4ca9-b64f-36db76cbdb6f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:07.380652 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3f82e35b-0281-4ca9-b64f-36db76cbdb6f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:07.389504 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3f82e35b-0281-4ca9-b64f-36db76cbdb6f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 0.179529 May 10 17:45:07.390095 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 31/67] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:07 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:07.497366 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-50d4f25f-7d97-4e79-b815-933304a099a6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:07.497366 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-50d4f25f-7d97-4e79-b815-933304a099a6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:07.502743 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-50d4f25f-7d97-4e79-b815-933304a099a6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:07.503476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-50d4f25f-7d97-4e79-b815-933304a099a6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:07.504325 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-50d4f25f-7d97-4e79-b815-933304a099a6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:07.505125 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-50d4f25f-7d97-4e79-b815-933304a099a6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:07.652966 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-50d4f25f-7d97-4e79-b815-933304a099a6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:07.661909 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-50d4f25f-7d97-4e79-b815-933304a099a6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.172421 May 10 17:45:07.662782 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 37/68] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:07 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:07.777198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0ebdd12e-540d-460b-a8ca-6e3008b36beb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:07.777817 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0ebdd12e-540d-460b-a8ca-6e3008b36beb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:07.784502 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0ebdd12e-540d-460b-a8ca-6e3008b36beb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:07.785080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0ebdd12e-540d-460b-a8ca-6e3008b36beb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:07.785738 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0ebdd12e-540d-460b-a8ca-6e3008b36beb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:07.786172 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0ebdd12e-540d-460b-a8ca-6e3008b36beb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:07.873746 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0ebdd12e-540d-460b-a8ca-6e3008b36beb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:07.881864 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0ebdd12e-540d-460b-a8ca-6e3008b36beb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1243 microversion: 2.1 time: 0.108972 May 10 17:45:07.882649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 32/69] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:07 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1243 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:08.192667 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-16d62a9d-0131-4822-93a7-1a6ac5993eca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:08.194048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-16d62a9d-0131-4822-93a7-1a6ac5993eca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:08.204213 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-16d62a9d-0131-4822-93a7-1a6ac5993eca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:08.205599 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-16d62a9d-0131-4822-93a7-1a6ac5993eca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:08.205764 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-16d62a9d-0131-4822-93a7-1a6ac5993eca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:08.206194 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-16d62a9d-0131-4822-93a7-1a6ac5993eca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:08.282697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-16d62a9d-0131-4822-93a7-1a6ac5993eca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:08.291212 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-16d62a9d-0131-4822-93a7-1a6ac5993eca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:08.293384 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-16d62a9d-0131-4822-93a7-1a6ac5993eca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:08.294751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-16d62a9d-0131-4822-93a7-1a6ac5993eca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1285 microversion: 2.20 time: 0.107996 May 10 17:45:08.295349 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 38/70] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:08 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:08.408308 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-aa556d58-629a-4812-966e-04cd56d1e4ad tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:08.409660 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-aa556d58-629a-4812-966e-04cd56d1e4ad tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:08.420386 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-aa556d58-629a-4812-966e-04cd56d1e4ad tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:08.420853 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-aa556d58-629a-4812-966e-04cd56d1e4ad tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:08.421646 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-aa556d58-629a-4812-966e-04cd56d1e4ad tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:08.422088 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-aa556d58-629a-4812-966e-04cd56d1e4ad tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:08.612436 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-aa556d58-629a-4812-966e-04cd56d1e4ad tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:08.622265 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-aa556d58-629a-4812-966e-04cd56d1e4ad tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 0.218714 May 10 17:45:08.623104 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 33/71] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:08 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:08.678063 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-84e96779-5b2c-4196-927e-c83cd48b8dab tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:08.678685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-84e96779-5b2c-4196-927e-c83cd48b8dab tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:08.686682 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-84e96779-5b2c-4196-927e-c83cd48b8dab tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:08.687144 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-84e96779-5b2c-4196-927e-c83cd48b8dab tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:08.687966 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-84e96779-5b2c-4196-927e-c83cd48b8dab tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:08.688542 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-84e96779-5b2c-4196-927e-c83cd48b8dab tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:08.845078 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-84e96779-5b2c-4196-927e-c83cd48b8dab tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:08.863354 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-84e96779-5b2c-4196-927e-c83cd48b8dab tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.181531 May 10 17:45:08.863354 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 39/72] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:08 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:08.908209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1beda8ef-13dc-485b-8a8b-9f5b68850cf7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:08.908852 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1beda8ef-13dc-485b-8a8b-9f5b68850cf7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:08.915927 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1beda8ef-13dc-485b-8a8b-9f5b68850cf7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:08.916642 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1beda8ef-13dc-485b-8a8b-9f5b68850cf7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:08.917478 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1beda8ef-13dc-485b-8a8b-9f5b68850cf7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:08.918734 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1beda8ef-13dc-485b-8a8b-9f5b68850cf7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:08.987870 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1beda8ef-13dc-485b-8a8b-9f5b68850cf7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:09.001073 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1beda8ef-13dc-485b-8a8b-9f5b68850cf7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1243 microversion: 2.1 time: 0.096731 May 10 17:45:09.002344 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 34/73] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:08 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1243 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:09.316976 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5fffa2b3-90b8-4b0e-a973-5422a2b1bed1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:09.317969 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5fffa2b3-90b8-4b0e-a973-5422a2b1bed1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:09.328397 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5fffa2b3-90b8-4b0e-a973-5422a2b1bed1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:09.329084 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5fffa2b3-90b8-4b0e-a973-5422a2b1bed1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:09.330017 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5fffa2b3-90b8-4b0e-a973-5422a2b1bed1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:09.330597 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5fffa2b3-90b8-4b0e-a973-5422a2b1bed1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:09.400026 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-5fffa2b3-90b8-4b0e-a973-5422a2b1bed1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:09.408986 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-5fffa2b3-90b8-4b0e-a973-5422a2b1bed1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:09.410581 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-5fffa2b3-90b8-4b0e-a973-5422a2b1bed1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:09.411884 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-5fffa2b3-90b8-4b0e-a973-5422a2b1bed1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1285 microversion: 2.20 time: 0.100923 May 10 17:45:09.412461 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 40/74] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:09 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:09.603284 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b70818fa-7425-457c-bf14-88f38bfcf11b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-307062580", "imageRef": "a7737c62-8029-44aa-8da7-e46fea7607fb", "flavorRef": "452"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:45:09.640750 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5143963e-1141-4a1a-bb28-886bd44e6f90 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:09.641639 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5143963e-1141-4a1a-bb28-886bd44e6f90 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:09.654825 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5143963e-1141-4a1a-bb28-886bd44e6f90 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:09.657161 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5143963e-1141-4a1a-bb28-886bd44e6f90 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:09.658273 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5143963e-1141-4a1a-bb28-886bd44e6f90 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:09.659727 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-b70818fa-7425-457c-bf14-88f38bfcf11b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] validate_networks() for None {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:45:09.660419 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5143963e-1141-4a1a-bb28-886bd44e6f90 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:10.292781 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-5143963e-1141-4a1a-bb28-886bd44e6f90 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:10.301641 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-5143963e-1141-4a1a-bb28-886bd44e6f90 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 0.664743 May 10 17:45:10.302343 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 41/75] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:09 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:10.308689 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-93db21cf-ace2-4d92-9016-0e2e1cf98cb6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:10.309583 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-93db21cf-ace2-4d92-9016-0e2e1cf98cb6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:10.321334 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-93db21cf-ace2-4d92-9016-0e2e1cf98cb6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:10.322730 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-93db21cf-ace2-4d92-9016-0e2e1cf98cb6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:10.323745 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-93db21cf-ace2-4d92-9016-0e2e1cf98cb6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:10.324200 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-93db21cf-ace2-4d92-9016-0e2e1cf98cb6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:10.343682 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-b70818fa-7425-457c-bf14-88f38bfcf11b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:45:10.344479 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-b70818fa-7425-457c-bf14-88f38bfcf11b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:45:10.345263 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-b70818fa-7425-457c-bf14-88f38bfcf11b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:45:10.345851 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-b70818fa-7425-457c-bf14-88f38bfcf11b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:45:10.346405 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-b70818fa-7425-457c-bf14-88f38bfcf11b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:45:10.359274 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b70818fa-7425-457c-bf14-88f38bfcf11b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:10.360045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b70818fa-7425-457c-bf14-88f38bfcf11b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:10.361058 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b70818fa-7425-457c-bf14-88f38bfcf11b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:10.362189 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b70818fa-7425-457c-bf14-88f38bfcf11b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:10.386419 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-b70818fa-7425-457c-bf14-88f38bfcf11b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Getting quotas for project 29260c09fcef4a49a7f9b244feca77cb. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:45:10.391148 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-b70818fa-7425-457c-bf14-88f38bfcf11b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Getting quotas for user 552433b497424e6fab5e83a5b3887d61 and project 29260c09fcef4a49a7f9b244feca77cb. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:45:10.405604 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b70818fa-7425-457c-bf14-88f38bfcf11b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:45:10.408763 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b70818fa-7425-457c-bf14-88f38bfcf11b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7737c62-8029-44aa-8da7-e46fea7607fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:45:10.473320 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b70818fa-7425-457c-bf14-88f38bfcf11b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.874372 May 10 17:45:10.473933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 35/76] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 17:45:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:45:10.479314 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-de4a5b7d-7681-48a2-9bef-ff822c214f5f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:10.479964 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-de4a5b7d-7681-48a2-9bef-ff822c214f5f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:10.486431 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-de4a5b7d-7681-48a2-9bef-ff822c214f5f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:10.487070 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-de4a5b7d-7681-48a2-9bef-ff822c214f5f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:10.487938 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-de4a5b7d-7681-48a2-9bef-ff822c214f5f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:10.488378 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-de4a5b7d-7681-48a2-9bef-ff822c214f5f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:10.588491 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-de4a5b7d-7681-48a2-9bef-ff822c214f5f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:10.599085 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-de4a5b7d-7681-48a2-9bef-ff822c214f5f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1291 microversion: 2.1 time: 0.123596 May 10 17:45:10.600687 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 36/77] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:10 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1291 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:10.610877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-93db21cf-ace2-4d92-9016-0e2e1cf98cb6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:10.621160 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-93db21cf-ace2-4d92-9016-0e2e1cf98cb6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.317403 May 10 17:45:10.621743 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 42/78] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:10 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:10.626819 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f78ef3af-822a-4f8e-a53e-168894c89ac7 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:10.627277 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9bbee87e-d2e9-4a52-9e45-f482d020ca6b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:10.628287 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9bbee87e-d2e9-4a52-9e45-f482d020ca6b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:10.628775 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f78ef3af-822a-4f8e-a53e-168894c89ac7 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:10.637676 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9bbee87e-d2e9-4a52-9e45-f482d020ca6b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:10.638446 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9bbee87e-d2e9-4a52-9e45-f482d020ca6b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:10.639416 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9bbee87e-d2e9-4a52-9e45-f482d020ca6b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:10.640260 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9bbee87e-d2e9-4a52-9e45-f482d020ca6b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:10.716641 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f78ef3af-822a-4f8e-a53e-168894c89ac7 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:10.726358 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f78ef3af-822a-4f8e-a53e-168894c89ac7 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1214 microversion: 2.1 time: 0.103257 May 10 17:45:10.737795 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 43/79] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:10 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:10.764170 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9bbee87e-d2e9-4a52-9e45-f482d020ca6b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:10.803116 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9bbee87e-d2e9-4a52-9e45-f482d020ca6b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:10.808478 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9bbee87e-d2e9-4a52-9e45-f482d020ca6b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:10.812418 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9bbee87e-d2e9-4a52-9e45-f482d020ca6b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1333 microversion: 2.20 time: 0.198506 May 10 17:45:10.825494 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 37/80] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:10 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1333 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:11.326771 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-096110e4-a951-4c51-bde0-2989904229ef tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:11.328927 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-096110e4-a951-4c51-bde0-2989904229ef tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:11.343195 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-096110e4-a951-4c51-bde0-2989904229ef tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:11.344938 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-096110e4-a951-4c51-bde0-2989904229ef tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:11.345939 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-096110e4-a951-4c51-bde0-2989904229ef tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:11.346558 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-096110e4-a951-4c51-bde0-2989904229ef tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:11.551418 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-096110e4-a951-4c51-bde0-2989904229ef tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:11.560988 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-096110e4-a951-4c51-bde0-2989904229ef tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 0.245888 May 10 17:45:11.564022 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 44/81] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:11 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:11.625771 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9a8c2d6a-f5d4-450f-a4b6-1fb8cd87f093 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:11.626402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9a8c2d6a-f5d4-450f-a4b6-1fb8cd87f093 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:11.639294 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-3fb0e6d1-217b-4ee3-8215-8cb8d9aad1ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:11.639947 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-3fb0e6d1-217b-4ee3-8215-8cb8d9aad1ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:11.644129 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9a8c2d6a-f5d4-450f-a4b6-1fb8cd87f093 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:11.644624 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9a8c2d6a-f5d4-450f-a4b6-1fb8cd87f093 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:11.646689 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3fb0e6d1-217b-4ee3-8215-8cb8d9aad1ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:11.647279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3fb0e6d1-217b-4ee3-8215-8cb8d9aad1ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:11.648761 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3fb0e6d1-217b-4ee3-8215-8cb8d9aad1ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:11.649579 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3fb0e6d1-217b-4ee3-8215-8cb8d9aad1ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:11.650232 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9a8c2d6a-f5d4-450f-a4b6-1fb8cd87f093 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:11.650864 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9a8c2d6a-f5d4-450f-a4b6-1fb8cd87f093 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:11.749383 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9a8c2d6a-f5d4-450f-a4b6-1fb8cd87f093 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:11.766829 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9a8c2d6a-f5d4-450f-a4b6-1fb8cd87f093 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1297 microversion: 2.1 time: 0.152283 May 10 17:45:11.767640 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 38/82] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:11 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1297 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:11.776984 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d40febe4-7f95-4da1-b17d-983b07c30042 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:11.777838 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d40febe4-7f95-4da1-b17d-983b07c30042 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:11.792763 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d40febe4-7f95-4da1-b17d-983b07c30042 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:11.793541 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d40febe4-7f95-4da1-b17d-983b07c30042 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:11.795152 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d40febe4-7f95-4da1-b17d-983b07c30042 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:11.795738 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d40febe4-7f95-4da1-b17d-983b07c30042 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:11.851830 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-3fb0e6d1-217b-4ee3-8215-8cb8d9aad1ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:11.872414 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-3fb0e6d1-217b-4ee3-8215-8cb8d9aad1ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.236763 May 10 17:45:11.873471 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 45/83] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:11 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:11.886269 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d40febe4-7f95-4da1-b17d-983b07c30042 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:11.893964 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-bce1f040-44dc-45eb-9d2b-43b1d63d696b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:11.894615 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-bce1f040-44dc-45eb-9d2b-43b1d63d696b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:11.894793 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d40febe4-7f95-4da1-b17d-983b07c30042 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1218 microversion: 2.1 time: 0.125752 May 10 17:45:11.896230 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 39/84] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:11 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:11.905461 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bce1f040-44dc-45eb-9d2b-43b1d63d696b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:11.906218 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bce1f040-44dc-45eb-9d2b-43b1d63d696b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:11.907001 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bce1f040-44dc-45eb-9d2b-43b1d63d696b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:11.907457 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bce1f040-44dc-45eb-9d2b-43b1d63d696b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:11.975970 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-bce1f040-44dc-45eb-9d2b-43b1d63d696b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:11.985118 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-bce1f040-44dc-45eb-9d2b-43b1d63d696b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:11.986718 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-bce1f040-44dc-45eb-9d2b-43b1d63d696b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:11.987974 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-bce1f040-44dc-45eb-9d2b-43b1d63d696b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1339 microversion: 2.20 time: 0.113287 May 10 17:45:11.988620 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 46/85] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:11 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1339 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:12.579866 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-93ef848c-a541-4d56-9b99-f31b6393fd73 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:12.580501 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-93ef848c-a541-4d56-9b99-f31b6393fd73 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:12.588457 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-93ef848c-a541-4d56-9b99-f31b6393fd73 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:12.589136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-93ef848c-a541-4d56-9b99-f31b6393fd73 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:12.589870 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-93ef848c-a541-4d56-9b99-f31b6393fd73 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:12.590362 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-93ef848c-a541-4d56-9b99-f31b6393fd73 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:12.782742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-93ef848c-a541-4d56-9b99-f31b6393fd73 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:12.785589 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8d60cde5-bfce-40d5-8cbc-6ce1b513747b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:12.786420 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8d60cde5-bfce-40d5-8cbc-6ce1b513747b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:12.791039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-93ef848c-a541-4d56-9b99-f31b6393fd73 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 0.215642 May 10 17:45:12.792166 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 40/86] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:12 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:12.798213 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8d60cde5-bfce-40d5-8cbc-6ce1b513747b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:12.798664 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8d60cde5-bfce-40d5-8cbc-6ce1b513747b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:12.799480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8d60cde5-bfce-40d5-8cbc-6ce1b513747b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:12.799922 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8d60cde5-bfce-40d5-8cbc-6ce1b513747b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:12.890199 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-38d3a999-a67c-44ea-96f4-365c552ddc51 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:12.891015 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-8d60cde5-bfce-40d5-8cbc-6ce1b513747b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:12.891325 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-38d3a999-a67c-44ea-96f4-365c552ddc51 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:12.901037 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8d60cde5-bfce-40d5-8cbc-6ce1b513747b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1297 microversion: 2.1 time: 0.119717 May 10 17:45:12.902122 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 47/87] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:12 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1297 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:12.903899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38d3a999-a67c-44ea-96f4-365c552ddc51 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:12.904797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38d3a999-a67c-44ea-96f4-365c552ddc51 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:12.905799 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38d3a999-a67c-44ea-96f4-365c552ddc51 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:12.906418 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38d3a999-a67c-44ea-96f4-365c552ddc51 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:12.916303 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b1b054f0-f38d-4909-bd04-a4df83a66c28 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:12.919336 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-b1b054f0-f38d-4909-bd04-a4df83a66c28 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:12.930436 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b1b054f0-f38d-4909-bd04-a4df83a66c28 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:12.932099 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b1b054f0-f38d-4909-bd04-a4df83a66c28 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:12.933326 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b1b054f0-f38d-4909-bd04-a4df83a66c28 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:12.934120 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b1b054f0-f38d-4909-bd04-a4df83a66c28 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:13.036285 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b1b054f0-f38d-4909-bd04-a4df83a66c28 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:13.048179 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b1b054f0-f38d-4909-bd04-a4df83a66c28 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1218 microversion: 2.1 time: 0.137693 May 10 17:45:13.049966 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 48/88] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:12 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1218 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:13.057283 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c32552a4-1c49-4bf8-8bcd-db8a949da771 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:13.057896 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c32552a4-1c49-4bf8-8bcd-db8a949da771 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:13.067031 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c32552a4-1c49-4bf8-8bcd-db8a949da771 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:13.067575 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c32552a4-1c49-4bf8-8bcd-db8a949da771 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:13.068408 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c32552a4-1c49-4bf8-8bcd-db8a949da771 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:13.068851 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c32552a4-1c49-4bf8-8bcd-db8a949da771 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:13.139740 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-38d3a999-a67c-44ea-96f4-365c552ddc51 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:13.147889 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-38d3a999-a67c-44ea-96f4-365c552ddc51 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.262492 May 10 17:45:13.148798 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 41/89] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:12 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:13.165732 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c32552a4-1c49-4bf8-8bcd-db8a949da771 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:13.175972 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c32552a4-1c49-4bf8-8bcd-db8a949da771 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:13.177738 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c32552a4-1c49-4bf8-8bcd-db8a949da771 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:13.179048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c32552a4-1c49-4bf8-8bcd-db8a949da771 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1339 microversion: 2.20 time: 0.127580 May 10 17:45:13.180361 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 49/90] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:13 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1339 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:13.808271 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7f10beb9-06eb-47c7-992e-a35d97ccccce tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:13.809646 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7f10beb9-06eb-47c7-992e-a35d97ccccce tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:13.823982 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7f10beb9-06eb-47c7-992e-a35d97ccccce tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:13.823982 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7f10beb9-06eb-47c7-992e-a35d97ccccce tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:13.823982 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7f10beb9-06eb-47c7-992e-a35d97ccccce tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:13.823982 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7f10beb9-06eb-47c7-992e-a35d97ccccce tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:13.918615 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-259baef3-3645-4d05-8296-586100b0b1fe tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:13.919357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-259baef3-3645-4d05-8296-586100b0b1fe tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:13.928342 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-259baef3-3645-4d05-8296-586100b0b1fe tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:13.944261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-259baef3-3645-4d05-8296-586100b0b1fe tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:13.953922 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-259baef3-3645-4d05-8296-586100b0b1fe tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:13.954560 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-259baef3-3645-4d05-8296-586100b0b1fe tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:14.048398 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7f10beb9-06eb-47c7-992e-a35d97ccccce tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:14.069425 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7f10beb9-06eb-47c7-992e-a35d97ccccce tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 0.264479 May 10 17:45:14.070887 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 42/91] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:13 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:14.131120 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-259baef3-3645-4d05-8296-586100b0b1fe tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:14.141455 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-259baef3-3645-4d05-8296-586100b0b1fe tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1297 microversion: 2.1 time: 0.227088 May 10 17:45:14.142574 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 50/92] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:13 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1297 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:14.148531 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fdaa2992-3e8d-4904-b453-e9e95b5be802 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:14.149302 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-fdaa2992-3e8d-4904-b453-e9e95b5be802 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:14.155892 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fdaa2992-3e8d-4904-b453-e9e95b5be802 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:14.159070 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fdaa2992-3e8d-4904-b453-e9e95b5be802 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:14.159070 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fdaa2992-3e8d-4904-b453-e9e95b5be802 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:14.159070 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fdaa2992-3e8d-4904-b453-e9e95b5be802 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:14.234616 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fdaa2992-3e8d-4904-b453-e9e95b5be802 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:14.242921 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-fdaa2992-3e8d-4904-b453-e9e95b5be802 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1266 microversion: 2.1 time: 0.099077 May 10 17:45:14.244369 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 51/93] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:14 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:14.249129 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-bce7c66d-5cae-4d9b-9f7b-f34bd802582a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:14.249740 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-bce7c66d-5cae-4d9b-9f7b-f34bd802582a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:14.259935 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bce7c66d-5cae-4d9b-9f7b-f34bd802582a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:14.260552 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bce7c66d-5cae-4d9b-9f7b-f34bd802582a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:14.261451 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bce7c66d-5cae-4d9b-9f7b-f34bd802582a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:14.262315 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bce7c66d-5cae-4d9b-9f7b-f34bd802582a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:14.397234 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-a3d333b4-8d8a-4689-afa9-ce4a17b99f4a req-fb59e23d-2bd5-4001-b1fe-f49739cccbcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd7903d-232c-4666-939c-eb22c6fbf01b", "name": "network-vif-plugged", "status": "completed", "tag": "dee56dfb-cae2-41f9-b79a-5dd4e4a84d7f"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:45:14.409936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-a3d333b4-8d8a-4689-afa9-ce4a17b99f4a req-fb59e23d-2bd5-4001-b1fe-f49739cccbcd service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:14.410391 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-a3d333b4-8d8a-4689-afa9-ce4a17b99f4a req-fb59e23d-2bd5-4001-b1fe-f49739cccbcd service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:14.439186 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-a3d333b4-8d8a-4689-afa9-ce4a17b99f4a req-fb59e23d-2bd5-4001-b1fe-f49739cccbcd service nova] Creating event network-vif-plugged:dee56dfb-cae2-41f9-b79a-5dd4e4a84d7f for instance acd7903d-232c-4666-939c-eb22c6fbf01b on hv-cinder-84130 May 10 17:45:14.455704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-a3d333b4-8d8a-4689-afa9-ce4a17b99f4a req-fb59e23d-2bd5-4001-b1fe-f49739cccbcd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.378303 May 10 17:45:14.461550 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 43/94] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:45:14.466268 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-bce7c66d-5cae-4d9b-9f7b-f34bd802582a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:14.467674 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-162484e8-6c13-48ba-881f-5b58d6466faf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:14.468378 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-162484e8-6c13-48ba-881f-5b58d6466faf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:14.477443 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-162484e8-6c13-48ba-881f-5b58d6466faf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:14.478219 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-162484e8-6c13-48ba-881f-5b58d6466faf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:14.479150 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-162484e8-6c13-48ba-881f-5b58d6466faf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:14.479770 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-162484e8-6c13-48ba-881f-5b58d6466faf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:14.482574 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-bce7c66d-5cae-4d9b-9f7b-f34bd802582a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.236399 May 10 17:45:14.483706 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 52/95] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:14 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:14.613639 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-162484e8-6c13-48ba-881f-5b58d6466faf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:14.642855 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-162484e8-6c13-48ba-881f-5b58d6466faf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:14.645146 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-162484e8-6c13-48ba-881f-5b58d6466faf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:14.646698 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-162484e8-6c13-48ba-881f-5b58d6466faf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1339 microversion: 2.20 time: 0.183275 May 10 17:45:14.659995 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 44/96] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:14 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1339 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:15.089830 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-467fe581-0333-46be-bd18-c48c0f1c364d tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:15.090561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-467fe581-0333-46be-bd18-c48c0f1c364d tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:15.106837 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-467fe581-0333-46be-bd18-c48c0f1c364d tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:15.120445 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-467fe581-0333-46be-bd18-c48c0f1c364d tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:15.121899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-467fe581-0333-46be-bd18-c48c0f1c364d tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:15.122719 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-467fe581-0333-46be-bd18-c48c0f1c364d tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:15.164234 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-18893721-2024-4887-bf53-1c9fe6f96716 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:15.167515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-18893721-2024-4887-bf53-1c9fe6f96716 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:15.178616 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-18893721-2024-4887-bf53-1c9fe6f96716 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:15.180034 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-18893721-2024-4887-bf53-1c9fe6f96716 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:15.183461 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-18893721-2024-4887-bf53-1c9fe6f96716 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:15.184290 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-18893721-2024-4887-bf53-1c9fe6f96716 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:15.396810 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-18893721-2024-4887-bf53-1c9fe6f96716 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:15.409295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-18893721-2024-4887-bf53-1c9fe6f96716 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1297 microversion: 2.1 time: 0.251503 May 10 17:45:15.411235 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 45/97] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:15 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1297 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:15.421217 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ab293b95-98b3-4e37-8590-b1d9d3fdf14d tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:15.425105 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ab293b95-98b3-4e37-8590-b1d9d3fdf14d tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:15.435265 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ab293b95-98b3-4e37-8590-b1d9d3fdf14d tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:15.437069 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ab293b95-98b3-4e37-8590-b1d9d3fdf14d tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:15.438800 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ab293b95-98b3-4e37-8590-b1d9d3fdf14d tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:15.439561 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ab293b95-98b3-4e37-8590-b1d9d3fdf14d tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:15.687676 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-467fe581-0333-46be-bd18-c48c0f1c364d tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:15.711540 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-467fe581-0333-46be-bd18-c48c0f1c364d tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 0.626269 May 10 17:45:15.712980 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 53/98] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:15 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:15.729197 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-90e2fb39-4766-4d13-949c-fc23d9228bef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:15.730092 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-90e2fb39-4766-4d13-949c-fc23d9228bef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:15.749259 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-90e2fb39-4766-4d13-949c-fc23d9228bef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:15.749974 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-90e2fb39-4766-4d13-949c-fc23d9228bef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:15.750921 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-90e2fb39-4766-4d13-949c-fc23d9228bef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:15.751554 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-90e2fb39-4766-4d13-949c-fc23d9228bef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:15.768048 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ab293b95-98b3-4e37-8590-b1d9d3fdf14d tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:15.782741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ab293b95-98b3-4e37-8590-b1d9d3fdf14d tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1272 microversion: 2.1 time: 0.369403 May 10 17:45:15.784677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 46/99] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:15 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1272 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:15.798498 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-396088ec-d6c2-4274-a43e-51a0f7cc1785 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:15.799263 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-396088ec-d6c2-4274-a43e-51a0f7cc1785 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:15.813668 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-396088ec-d6c2-4274-a43e-51a0f7cc1785 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:15.814634 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-396088ec-d6c2-4274-a43e-51a0f7cc1785 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:15.815737 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-396088ec-d6c2-4274-a43e-51a0f7cc1785 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:15.816587 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-396088ec-d6c2-4274-a43e-51a0f7cc1785 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:16.062576 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-396088ec-d6c2-4274-a43e-51a0f7cc1785 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:16.090709 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-396088ec-d6c2-4274-a43e-51a0f7cc1785 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:16.097554 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-396088ec-d6c2-4274-a43e-51a0f7cc1785 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:16.106888 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-396088ec-d6c2-4274-a43e-51a0f7cc1785 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1339 microversion: 2.20 time: 0.318301 May 10 17:45:16.121704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 47/100] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:15 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1339 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:16.170948 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-90e2fb39-4766-4d13-949c-fc23d9228bef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:16.191393 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-90e2fb39-4766-4d13-949c-fc23d9228bef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.476745 May 10 17:45:16.194953 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 54/101] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:15 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:16.436379 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9bc2df6b-a43d-4716-86cd-b7da01e358b7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:16.439748 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9bc2df6b-a43d-4716-86cd-b7da01e358b7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:16.457926 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9bc2df6b-a43d-4716-86cd-b7da01e358b7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:16.464932 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9bc2df6b-a43d-4716-86cd-b7da01e358b7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:16.468491 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9bc2df6b-a43d-4716-86cd-b7da01e358b7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:16.469256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9bc2df6b-a43d-4716-86cd-b7da01e358b7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:16.730378 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f8ee95ae-bb6e-48a8-918a-b325814bb024 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:16.731397 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f8ee95ae-bb6e-48a8-918a-b325814bb024 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:16.746878 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f8ee95ae-bb6e-48a8-918a-b325814bb024 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:16.747889 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f8ee95ae-bb6e-48a8-918a-b325814bb024 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:16.749041 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f8ee95ae-bb6e-48a8-918a-b325814bb024 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:16.749703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f8ee95ae-bb6e-48a8-918a-b325814bb024 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:17.050653 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9bc2df6b-a43d-4716-86cd-b7da01e358b7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:17.069625 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9bc2df6b-a43d-4716-86cd-b7da01e358b7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.642419 May 10 17:45:17.076026 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 48/102] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:16 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:17.090484 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7375f3b3-fa93-4a80-8e56-3df35cab356a tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:17.092836 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7375f3b3-fa93-4a80-8e56-3df35cab356a tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:17.107973 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7375f3b3-fa93-4a80-8e56-3df35cab356a tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:17.108765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7375f3b3-fa93-4a80-8e56-3df35cab356a tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:17.109723 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7375f3b3-fa93-4a80-8e56-3df35cab356a tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:17.113368 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7375f3b3-fa93-4a80-8e56-3df35cab356a tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:17.124185 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f8ee95ae-bb6e-48a8-918a-b325814bb024 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:17.137075 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f8ee95ae-bb6e-48a8-918a-b325814bb024 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 0.412014 May 10 17:45:17.138218 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 55/103] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:16 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:17.143884 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ba65ba92-e2a3-4db5-919c-a7b571b613d6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:17.148607 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ba65ba92-e2a3-4db5-919c-a7b571b613d6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:17.164465 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ba65ba92-e2a3-4db5-919c-a7b571b613d6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:17.167623 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ba65ba92-e2a3-4db5-919c-a7b571b613d6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:17.168647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ba65ba92-e2a3-4db5-919c-a7b571b613d6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:17.171840 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ba65ba92-e2a3-4db5-919c-a7b571b613d6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:17.250618 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7375f3b3-fa93-4a80-8e56-3df35cab356a tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:17.261880 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7375f3b3-fa93-4a80-8e56-3df35cab356a tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1272 microversion: 2.1 time: 0.184484 May 10 17:45:17.263736 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 49/104] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:17 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:17.270009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-34bb9eb0-771e-4a11-a957-d38921e65ab6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:17.270861 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-34bb9eb0-771e-4a11-a957-d38921e65ab6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:17.298933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34bb9eb0-771e-4a11-a957-d38921e65ab6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:17.299521 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34bb9eb0-771e-4a11-a957-d38921e65ab6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:17.303413 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34bb9eb0-771e-4a11-a957-d38921e65ab6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:17.304282 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34bb9eb0-771e-4a11-a957-d38921e65ab6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:17.590003 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ba65ba92-e2a3-4db5-919c-a7b571b613d6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:17.600524 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ba65ba92-e2a3-4db5-919c-a7b571b613d6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:17.605102 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ba65ba92-e2a3-4db5-919c-a7b571b613d6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:17.618404 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ba65ba92-e2a3-4db5-919c-a7b571b613d6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1407 microversion: 2.20 time: 0.478072 May 10 17:45:17.619018 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 56/105] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:17 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:17.631983 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-34bb9eb0-771e-4a11-a957-d38921e65ab6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:17.635587 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-2c67e1a7-a6a2-4a74-8fd1-bd7d8d8051cb req-4f2f6a58-fc43-40ba-b1bd-d9230c4c7de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bf8bc9-b3de-4555-8835-15dd3a89bc56", "name": "network-vif-plugged", "status": "completed", "tag": "552e62e9-0e95-4838-9c01-aa3425c6c9c6"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:45:17.640927 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-34bb9eb0-771e-4a11-a957-d38921e65ab6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.375982 May 10 17:45:17.646412 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 50/106] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:17 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:17.682588 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-2c67e1a7-a6a2-4a74-8fd1-bd7d8d8051cb req-4f2f6a58-fc43-40ba-b1bd-d9230c4c7de5 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:17.683035 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-2c67e1a7-a6a2-4a74-8fd1-bd7d8d8051cb req-4f2f6a58-fc43-40ba-b1bd-d9230c4c7de5 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:17.729236 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-2c67e1a7-a6a2-4a74-8fd1-bd7d8d8051cb req-4f2f6a58-fc43-40ba-b1bd-d9230c4c7de5 service nova] Creating event network-vif-plugged:552e62e9-0e95-4838-9c01-aa3425c6c9c6 for instance c1bf8bc9-b3de-4555-8835-15dd3a89bc56 on hv-cinder-84130 May 10 17:45:17.745390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-2c67e1a7-a6a2-4a74-8fd1-bd7d8d8051cb req-4f2f6a58-fc43-40ba-b1bd-d9230c4c7de5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118080 May 10 17:45:17.746127 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 57/107] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:45:18.093636 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6d8968d2-bf3a-4729-86fd-4ae80fc335a1 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:18.094249 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6d8968d2-bf3a-4729-86fd-4ae80fc335a1 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:18.102076 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6d8968d2-bf3a-4729-86fd-4ae80fc335a1 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:18.102761 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6d8968d2-bf3a-4729-86fd-4ae80fc335a1 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:18.103576 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6d8968d2-bf3a-4729-86fd-4ae80fc335a1 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:18.104015 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6d8968d2-bf3a-4729-86fd-4ae80fc335a1 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:18.166897 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-53cb4a9d-fe27-4fb6-b746-171c7d2b9488 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:18.167623 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-53cb4a9d-fe27-4fb6-b746-171c7d2b9488 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:18.173691 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-53cb4a9d-fe27-4fb6-b746-171c7d2b9488 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:18.174814 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-53cb4a9d-fe27-4fb6-b746-171c7d2b9488 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:18.175844 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-53cb4a9d-fe27-4fb6-b746-171c7d2b9488 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:18.176288 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-53cb4a9d-fe27-4fb6-b746-171c7d2b9488 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:18.296326 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6d8968d2-bf3a-4729-86fd-4ae80fc335a1 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:18.304511 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6d8968d2-bf3a-4729-86fd-4ae80fc335a1 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.215457 May 10 17:45:18.309424 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 51/108] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:18 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:18.323528 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b268bc14-3394-4281-9060-4cbfb558728f tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:18.324250 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b268bc14-3394-4281-9060-4cbfb558728f tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:18.331789 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b268bc14-3394-4281-9060-4cbfb558728f tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:18.332986 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b268bc14-3394-4281-9060-4cbfb558728f tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:18.334622 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b268bc14-3394-4281-9060-4cbfb558728f tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:18.336567 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b268bc14-3394-4281-9060-4cbfb558728f tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:18.409349 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-53cb4a9d-fe27-4fb6-b746-171c7d2b9488 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:18.418960 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-53cb4a9d-fe27-4fb6-b746-171c7d2b9488 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 0.256365 May 10 17:45:18.429800 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 58/109] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:18 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:18.517069 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b268bc14-3394-4281-9060-4cbfb558728f tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:18.545667 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b268bc14-3394-4281-9060-4cbfb558728f tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1314 microversion: 2.1 time: 0.234022 May 10 17:45:18.546246 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 52/110] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:18 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:18.648595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e393c091-e4d0-4dee-82c9-a347c5331442 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:18.648904 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e393c091-e4d0-4dee-82c9-a347c5331442 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:18.664508 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c2654e14-c275-41b1-922a-1908898cab05 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:18.666129 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c2654e14-c275-41b1-922a-1908898cab05 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:18.669099 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e393c091-e4d0-4dee-82c9-a347c5331442 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:18.670006 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e393c091-e4d0-4dee-82c9-a347c5331442 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:18.671059 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e393c091-e4d0-4dee-82c9-a347c5331442 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:18.671740 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e393c091-e4d0-4dee-82c9-a347c5331442 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:18.686069 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c2654e14-c275-41b1-922a-1908898cab05 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:18.686691 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c2654e14-c275-41b1-922a-1908898cab05 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:18.687920 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c2654e14-c275-41b1-922a-1908898cab05 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:18.688586 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c2654e14-c275-41b1-922a-1908898cab05 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:18.932445 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e393c091-e4d0-4dee-82c9-a347c5331442 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:18.952066 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e393c091-e4d0-4dee-82c9-a347c5331442 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:18.954263 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e393c091-e4d0-4dee-82c9-a347c5331442 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:18.957341 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e393c091-e4d0-4dee-82c9-a347c5331442 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1407 microversion: 2.20 time: 0.324736 May 10 17:45:18.958483 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 59/111] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:18 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1407 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:18.959433 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c2654e14-c275-41b1-922a-1908898cab05 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:18.972515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c2654e14-c275-41b1-922a-1908898cab05 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.312210 May 10 17:45:18.973583 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 53/112] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:18 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:19.047615 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-32d4c189-1687-471f-8254-70065781579f req-bba62cc1-6233-4f33-8baa-e4775190decd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35dc394b-a596-4f36-89cf-f60e42d697d1", "tag": "6f6bce01-999d-439d-8315-53c87197c824"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:45:19.064071 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-32d4c189-1687-471f-8254-70065781579f req-bba62cc1-6233-4f33-8baa-e4775190decd service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:19.065458 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-32d4c189-1687-471f-8254-70065781579f req-bba62cc1-6233-4f33-8baa-e4775190decd service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:19.108728 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-32d4c189-1687-471f-8254-70065781579f req-bba62cc1-6233-4f33-8baa-e4775190decd service nova] Creating event network-changed:6f6bce01-999d-439d-8315-53c87197c824 for instance 35dc394b-a596-4f36-89cf-f60e42d697d1 on hv-cinder-84130 May 10 17:45:19.125825 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-32d4c189-1687-471f-8254-70065781579f req-bba62cc1-6233-4f33-8baa-e4775190decd service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081846 May 10 17:45:19.127052 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 60/113] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:45:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:45:19.334529 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6efbe372-9d43-47f2-994e-b3bea84e96f9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:19.335162 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6efbe372-9d43-47f2-994e-b3bea84e96f9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:19.350673 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6efbe372-9d43-47f2-994e-b3bea84e96f9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:19.351178 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6efbe372-9d43-47f2-994e-b3bea84e96f9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:19.352828 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6efbe372-9d43-47f2-994e-b3bea84e96f9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:19.353694 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6efbe372-9d43-47f2-994e-b3bea84e96f9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:19.437545 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2e46f149-1b1f-47c3-8dcf-290be2155f3c tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:19.438728 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-2e46f149-1b1f-47c3-8dcf-290be2155f3c tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:19.469429 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2e46f149-1b1f-47c3-8dcf-290be2155f3c tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:19.470228 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2e46f149-1b1f-47c3-8dcf-290be2155f3c tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:19.478043 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2e46f149-1b1f-47c3-8dcf-290be2155f3c tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:19.481406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2e46f149-1b1f-47c3-8dcf-290be2155f3c tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:19.809817 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6efbe372-9d43-47f2-994e-b3bea84e96f9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:19.823776 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6efbe372-9d43-47f2-994e-b3bea84e96f9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.501553 May 10 17:45:19.824606 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 54/114] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:19 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:19.829429 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8db54ba2-89c8-402d-b694-120cdbd28806 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:19.830056 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8db54ba2-89c8-402d-b694-120cdbd28806 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:19.839956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8db54ba2-89c8-402d-b694-120cdbd28806 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:19.840592 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8db54ba2-89c8-402d-b694-120cdbd28806 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:19.841347 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8db54ba2-89c8-402d-b694-120cdbd28806 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:19.841937 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8db54ba2-89c8-402d-b694-120cdbd28806 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:19.888670 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-2e46f149-1b1f-47c3-8dcf-290be2155f3c tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:19.901735 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-2e46f149-1b1f-47c3-8dcf-290be2155f3c tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1315 microversion: 2.1 time: 0.468407 May 10 17:45:19.902659 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 61/115] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:19 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1315 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:19.978438 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b41d197b-d3f9-4988-9c8e-b7199ecc4889 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:19.979136 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-b41d197b-d3f9-4988-9c8e-b7199ecc4889 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:19.987617 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b41d197b-d3f9-4988-9c8e-b7199ecc4889 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:19.988080 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b41d197b-d3f9-4988-9c8e-b7199ecc4889 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:19.988857 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b41d197b-d3f9-4988-9c8e-b7199ecc4889 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:19.989293 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b41d197b-d3f9-4988-9c8e-b7199ecc4889 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:20.103245 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8db54ba2-89c8-402d-b694-120cdbd28806 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:20.110806 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8db54ba2-89c8-402d-b694-120cdbd28806 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1314 microversion: 2.1 time: 0.285015 May 10 17:45:20.111401 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 55/116] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:19 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:20.128891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7ebf4600-da2c-4d74-90f1-11f7bdafeddf tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:20.129519 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7ebf4600-da2c-4d74-90f1-11f7bdafeddf tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:20.145508 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7ebf4600-da2c-4d74-90f1-11f7bdafeddf tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:20.146102 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7ebf4600-da2c-4d74-90f1-11f7bdafeddf tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:20.147173 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7ebf4600-da2c-4d74-90f1-11f7bdafeddf tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:20.147649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7ebf4600-da2c-4d74-90f1-11f7bdafeddf tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:20.305895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b41d197b-d3f9-4988-9c8e-b7199ecc4889 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:20.321602 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b41d197b-d3f9-4988-9c8e-b7199ecc4889 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:20.323243 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b41d197b-d3f9-4988-9c8e-b7199ecc4889 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:20.324593 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b41d197b-d3f9-4988-9c8e-b7199ecc4889 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1407 microversion: 2.20 time: 0.350049 May 10 17:45:20.325903 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 62/117] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:19 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:45:20.418380 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7ebf4600-da2c-4d74-90f1-11f7bdafeddf tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:20.426136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7ebf4600-da2c-4d74-90f1-11f7bdafeddf tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.313709 May 10 17:45:20.436210 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 56/118] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:20 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:20.652259 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-9a6e11bd-b9ba-41f3-ad53-c0d532d79284 req-78aa458d-4631-4084-89c5-01971c3260d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "539078bb-d792-45a6-ab73-310f58397edc", "tag": "2777dc00-4366-4f2e-8110-14038b7477ab"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:45:20.670368 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-9a6e11bd-b9ba-41f3-ad53-c0d532d79284 req-78aa458d-4631-4084-89c5-01971c3260d1 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:20.670887 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-9a6e11bd-b9ba-41f3-ad53-c0d532d79284 req-78aa458d-4631-4084-89c5-01971c3260d1 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:20.709748 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-9a6e11bd-b9ba-41f3-ad53-c0d532d79284 req-78aa458d-4631-4084-89c5-01971c3260d1 service nova] Creating event network-changed:2777dc00-4366-4f2e-8110-14038b7477ab for instance 539078bb-d792-45a6-ab73-310f58397edc on hv-cinder-84130 May 10 17:45:20.737151 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-9a6e11bd-b9ba-41f3-ad53-c0d532d79284 req-78aa458d-4631-4084-89c5-01971c3260d1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073338 May 10 17:45:20.740650 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 63/119] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:45:20.844943 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9bda335a-9ced-4444-85da-fee34023dd91 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:20.845565 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9bda335a-9ced-4444-85da-fee34023dd91 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:20.857042 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9bda335a-9ced-4444-85da-fee34023dd91 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:20.857702 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9bda335a-9ced-4444-85da-fee34023dd91 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:20.858638 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9bda335a-9ced-4444-85da-fee34023dd91 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:20.859264 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9bda335a-9ced-4444-85da-fee34023dd91 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:20.921272 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-6ef10841-72f5-4b69-81b6-659763232a5e tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:20.921896 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-6ef10841-72f5-4b69-81b6-659763232a5e tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:20.932929 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6ef10841-72f5-4b69-81b6-659763232a5e tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:20.933341 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6ef10841-72f5-4b69-81b6-659763232a5e tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:20.934929 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6ef10841-72f5-4b69-81b6-659763232a5e tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:20.935578 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6ef10841-72f5-4b69-81b6-659763232a5e tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:21.095198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9bda335a-9ced-4444-85da-fee34023dd91 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:21.108851 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9bda335a-9ced-4444-85da-fee34023dd91 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.267683 May 10 17:45:21.119751 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 57/120] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:20 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:21.128523 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0cd71d8a-77ca-405a-b141-932c4a2d8327 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:21.129144 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0cd71d8a-77ca-405a-b141-932c4a2d8327 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:21.144823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cd71d8a-77ca-405a-b141-932c4a2d8327 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:21.145284 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cd71d8a-77ca-405a-b141-932c4a2d8327 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:21.146083 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cd71d8a-77ca-405a-b141-932c4a2d8327 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:21.146529 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cd71d8a-77ca-405a-b141-932c4a2d8327 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:21.147388 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6ef10841-72f5-4b69-81b6-659763232a5e tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:21.166391 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-6ef10841-72f5-4b69-81b6-659763232a5e tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1502 microversion: 2.1 time: 0.250227 May 10 17:45:21.167589 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 64/121] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:20 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1502 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:21.201848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-3595ea95-b04c-40c5-93e3-113accd750b6 req-8d8e0828-acb2-47fe-bded-d6364802b2ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4006eed6-2338-46b7-9133-e5c3fdead35c", "tag": "e697d9cb-ff2b-45a4-8326-f3219cdf4121"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:45:21.219331 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-3595ea95-b04c-40c5-93e3-113accd750b6 req-8d8e0828-acb2-47fe-bded-d6364802b2ae service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:21.219817 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-3595ea95-b04c-40c5-93e3-113accd750b6 req-8d8e0828-acb2-47fe-bded-d6364802b2ae service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:21.245185 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-3595ea95-b04c-40c5-93e3-113accd750b6 req-8d8e0828-acb2-47fe-bded-d6364802b2ae service nova] Creating event network-changed:e697d9cb-ff2b-45a4-8326-f3219cdf4121 for instance 4006eed6-2338-46b7-9133-e5c3fdead35c on hv-cinder-84130 May 10 17:45:21.260414 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-3595ea95-b04c-40c5-93e3-113accd750b6 req-8d8e0828-acb2-47fe-bded-d6364802b2ae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065333 May 10 17:45:21.261314 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 65/122] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:45:21.344993 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-670bb4f1-41f0-4e23-9433-87ffbcffbfa2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:21.345841 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-670bb4f1-41f0-4e23-9433-87ffbcffbfa2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:21.356326 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-670bb4f1-41f0-4e23-9433-87ffbcffbfa2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:21.359792 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-670bb4f1-41f0-4e23-9433-87ffbcffbfa2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:21.360750 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-670bb4f1-41f0-4e23-9433-87ffbcffbfa2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:21.361427 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-670bb4f1-41f0-4e23-9433-87ffbcffbfa2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:21.372134 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0cd71d8a-77ca-405a-b141-932c4a2d8327 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:21.386278 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0cd71d8a-77ca-405a-b141-932c4a2d8327 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1314 microversion: 2.1 time: 0.261488 May 10 17:45:21.387040 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 58/123] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:21 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:21.444230 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-be3a57ff-bc21-4912-aa0f-d5aa2362ec7e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:21.446540 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-be3a57ff-bc21-4912-aa0f-d5aa2362ec7e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:21.458681 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-be3a57ff-bc21-4912-aa0f-d5aa2362ec7e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:21.461569 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-be3a57ff-bc21-4912-aa0f-d5aa2362ec7e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:21.462610 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-be3a57ff-bc21-4912-aa0f-d5aa2362ec7e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:21.464306 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-be3a57ff-bc21-4912-aa0f-d5aa2362ec7e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:21.681822 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-670bb4f1-41f0-4e23-9433-87ffbcffbfa2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:21.695417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-670bb4f1-41f0-4e23-9433-87ffbcffbfa2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:21.703313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-670bb4f1-41f0-4e23-9433-87ffbcffbfa2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:21.704987 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-670bb4f1-41f0-4e23-9433-87ffbcffbfa2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1407 microversion: 2.20 time: 0.366191 May 10 17:45:21.705821 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 66/124] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:21 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1407 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:21.749411 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-be3a57ff-bc21-4912-aa0f-d5aa2362ec7e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:21.765566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-be3a57ff-bc21-4912-aa0f-d5aa2362ec7e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.325336 May 10 17:45:21.769079 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 59/125] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:21 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:22.126723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9db0fd7a-2fe6-48a6-93f8-9cb969c64417 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:22.127246 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-9db0fd7a-2fe6-48a6-93f8-9cb969c64417 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:22.133477 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9db0fd7a-2fe6-48a6-93f8-9cb969c64417 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:22.134014 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9db0fd7a-2fe6-48a6-93f8-9cb969c64417 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:22.134736 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9db0fd7a-2fe6-48a6-93f8-9cb969c64417 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:22.135177 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9db0fd7a-2fe6-48a6-93f8-9cb969c64417 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:22.272832 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-9db0fd7a-2fe6-48a6-93f8-9cb969c64417 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:22.281612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-9db0fd7a-2fe6-48a6-93f8-9cb969c64417 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.158777 May 10 17:45:22.282208 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 67/126] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:22 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:22.404772 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f78ffa8f-8158-4836-90b3-a0d423fbf1af tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:22.406039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f78ffa8f-8158-4836-90b3-a0d423fbf1af tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:22.412129 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f78ffa8f-8158-4836-90b3-a0d423fbf1af tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:22.412793 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f78ffa8f-8158-4836-90b3-a0d423fbf1af tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:22.413654 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f78ffa8f-8158-4836-90b3-a0d423fbf1af tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:22.414373 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f78ffa8f-8158-4836-90b3-a0d423fbf1af tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:22.562206 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f78ffa8f-8158-4836-90b3-a0d423fbf1af tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:22.573614 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f78ffa8f-8158-4836-90b3-a0d423fbf1af tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1314 microversion: 2.1 time: 0.173131 May 10 17:45:22.574265 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 60/127] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:22 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:22.725177 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f72e1c35-bee8-4e13-bfff-ce4a1117e244 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:22.726380 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f72e1c35-bee8-4e13-bfff-ce4a1117e244 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:22.732957 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f72e1c35-bee8-4e13-bfff-ce4a1117e244 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:22.733422 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f72e1c35-bee8-4e13-bfff-ce4a1117e244 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:22.734225 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f72e1c35-bee8-4e13-bfff-ce4a1117e244 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:22.734696 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f72e1c35-bee8-4e13-bfff-ce4a1117e244 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:22.793504 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7e9f6249-b05a-4398-8792-ed5b0ef7f5be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:22.794278 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7e9f6249-b05a-4398-8792-ed5b0ef7f5be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:22.800627 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7e9f6249-b05a-4398-8792-ed5b0ef7f5be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:22.803202 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7e9f6249-b05a-4398-8792-ed5b0ef7f5be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:22.803202 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7e9f6249-b05a-4398-8792-ed5b0ef7f5be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:22.803202 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7e9f6249-b05a-4398-8792-ed5b0ef7f5be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:22.939336 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f72e1c35-bee8-4e13-bfff-ce4a1117e244 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:22.948859 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f72e1c35-bee8-4e13-bfff-ce4a1117e244 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:22.950670 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f72e1c35-bee8-4e13-bfff-ce4a1117e244 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:22.952070 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f72e1c35-bee8-4e13-bfff-ce4a1117e244 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1407 microversion: 2.20 time: 0.230732 May 10 17:45:22.952892 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 68/128] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:22 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:22.987822 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7e9f6249-b05a-4398-8792-ed5b0ef7f5be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:22.995798 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7e9f6249-b05a-4398-8792-ed5b0ef7f5be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.207728 May 10 17:45:22.996357 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 61/129] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:22 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:23.299756 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f865b8e3-8109-420a-b374-7b17aeaee941 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:23.300262 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f865b8e3-8109-420a-b374-7b17aeaee941 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:23.307494 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f865b8e3-8109-420a-b374-7b17aeaee941 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:23.308015 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f865b8e3-8109-420a-b374-7b17aeaee941 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:23.308787 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f865b8e3-8109-420a-b374-7b17aeaee941 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:23.309219 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f865b8e3-8109-420a-b374-7b17aeaee941 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:23.440236 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f865b8e3-8109-420a-b374-7b17aeaee941 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:23.449561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f865b8e3-8109-420a-b374-7b17aeaee941 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.153691 May 10 17:45:23.450149 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 69/130] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:23 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:23.591085 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6ce1eb26-e3a8-442d-ae8a-04ab8e13c68e tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:23.591643 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6ce1eb26-e3a8-442d-ae8a-04ab8e13c68e tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:23.597566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6ce1eb26-e3a8-442d-ae8a-04ab8e13c68e tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:23.598022 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6ce1eb26-e3a8-442d-ae8a-04ab8e13c68e tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:23.598793 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6ce1eb26-e3a8-442d-ae8a-04ab8e13c68e tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:23.599234 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6ce1eb26-e3a8-442d-ae8a-04ab8e13c68e tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:23.734088 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6ce1eb26-e3a8-442d-ae8a-04ab8e13c68e tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:23.742158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6ce1eb26-e3a8-442d-ae8a-04ab8e13c68e tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1314 microversion: 2.1 time: 0.154585 May 10 17:45:23.743706 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 62/131] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:23 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:23.970284 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-340ba4e8-d47d-4021-8b1b-034277ffad9e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:23.970886 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-340ba4e8-d47d-4021-8b1b-034277ffad9e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:23.978156 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-340ba4e8-d47d-4021-8b1b-034277ffad9e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:23.983893 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-340ba4e8-d47d-4021-8b1b-034277ffad9e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:23.984807 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-340ba4e8-d47d-4021-8b1b-034277ffad9e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:23.985248 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-340ba4e8-d47d-4021-8b1b-034277ffad9e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:24.022506 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0c718691-9b69-490c-b48b-84de951ae1bb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:24.023949 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0c718691-9b69-490c-b48b-84de951ae1bb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:24.030775 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0c718691-9b69-490c-b48b-84de951ae1bb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:24.031241 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0c718691-9b69-490c-b48b-84de951ae1bb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:24.032680 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0c718691-9b69-490c-b48b-84de951ae1bb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:24.033637 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0c718691-9b69-490c-b48b-84de951ae1bb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:24.197792 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-340ba4e8-d47d-4021-8b1b-034277ffad9e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:24.206159 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-340ba4e8-d47d-4021-8b1b-034277ffad9e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:24.207804 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-340ba4e8-d47d-4021-8b1b-034277ffad9e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:24.209019 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-340ba4e8-d47d-4021-8b1b-034277ffad9e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1407 microversion: 2.20 time: 0.242635 May 10 17:45:24.209807 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 70/132] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:23 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:45:24.233152 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0c718691-9b69-490c-b48b-84de951ae1bb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:24.239187 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0c718691-9b69-490c-b48b-84de951ae1bb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.229166 May 10 17:45:24.239187 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 63/133] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:24 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:24.468134 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5439c6b2-a7be-4f04-b4b5-6b6bf3ae157e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:24.469115 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5439c6b2-a7be-4f04-b4b5-6b6bf3ae157e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:24.476275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5439c6b2-a7be-4f04-b4b5-6b6bf3ae157e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:24.476729 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5439c6b2-a7be-4f04-b4b5-6b6bf3ae157e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:24.478155 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5439c6b2-a7be-4f04-b4b5-6b6bf3ae157e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:24.478704 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5439c6b2-a7be-4f04-b4b5-6b6bf3ae157e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:24.651135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-5439c6b2-a7be-4f04-b4b5-6b6bf3ae157e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:24.663125 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-5439c6b2-a7be-4f04-b4b5-6b6bf3ae157e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.199057 May 10 17:45:24.665208 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 71/134] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:24 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:24.759999 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3df5a788-ef30-481d-9656-b1b98ee8b375 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:24.760666 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3df5a788-ef30-481d-9656-b1b98ee8b375 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:24.767259 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3df5a788-ef30-481d-9656-b1b98ee8b375 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:24.767735 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3df5a788-ef30-481d-9656-b1b98ee8b375 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:24.768511 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3df5a788-ef30-481d-9656-b1b98ee8b375 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:24.768943 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3df5a788-ef30-481d-9656-b1b98ee8b375 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:24.906287 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3df5a788-ef30-481d-9656-b1b98ee8b375 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:24.915095 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3df5a788-ef30-481d-9656-b1b98ee8b375 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1314 microversion: 2.1 time: 0.158890 May 10 17:45:24.915712 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 64/135] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:24 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:25.228775 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-60651a72-309f-4a00-9db6-80aab3edec86 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:25.229382 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-60651a72-309f-4a00-9db6-80aab3edec86 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:25.235507 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-60651a72-309f-4a00-9db6-80aab3edec86 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:25.235960 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-60651a72-309f-4a00-9db6-80aab3edec86 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:25.236721 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-60651a72-309f-4a00-9db6-80aab3edec86 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:25.237160 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-60651a72-309f-4a00-9db6-80aab3edec86 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:25.255351 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7284a5e4-d0ee-4797-84c9-e1eb5f901e37 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:25.255980 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7284a5e4-d0ee-4797-84c9-e1eb5f901e37 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:25.262432 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7284a5e4-d0ee-4797-84c9-e1eb5f901e37 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:25.262916 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7284a5e4-d0ee-4797-84c9-e1eb5f901e37 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:25.263714 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7284a5e4-d0ee-4797-84c9-e1eb5f901e37 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:25.264152 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7284a5e4-d0ee-4797-84c9-e1eb5f901e37 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:25.435852 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-60651a72-309f-4a00-9db6-80aab3edec86 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:25.440236 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7284a5e4-d0ee-4797-84c9-e1eb5f901e37 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:25.446540 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-60651a72-309f-4a00-9db6-80aab3edec86 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:25.448177 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-60651a72-309f-4a00-9db6-80aab3edec86 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:25.449481 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7284a5e4-d0ee-4797-84c9-e1eb5f901e37 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.197943 May 10 17:45:25.449599 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-60651a72-309f-4a00-9db6-80aab3edec86 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1407 microversion: 2.20 time: 0.224572 May 10 17:45:25.450423 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 65/137] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:25 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:25.450530 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 72/137] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:25 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:25.685367 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-07043c9d-f10b-4cbe-8e01-69787fa7ea5c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:25.685980 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-07043c9d-f10b-4cbe-8e01-69787fa7ea5c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:25.691938 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-07043c9d-f10b-4cbe-8e01-69787fa7ea5c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:25.692387 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-07043c9d-f10b-4cbe-8e01-69787fa7ea5c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:25.693149 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-07043c9d-f10b-4cbe-8e01-69787fa7ea5c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:25.693583 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-07043c9d-f10b-4cbe-8e01-69787fa7ea5c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:25.829896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-07043c9d-f10b-4cbe-8e01-69787fa7ea5c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:25.837655 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-07043c9d-f10b-4cbe-8e01-69787fa7ea5c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.156049 May 10 17:45:25.838243 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 66/138] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:25 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:25.933377 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c610cecb-e2fb-4030-a46e-b44d75151c2b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:25.933981 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c610cecb-e2fb-4030-a46e-b44d75151c2b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:25.939988 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c610cecb-e2fb-4030-a46e-b44d75151c2b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:25.940375 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c610cecb-e2fb-4030-a46e-b44d75151c2b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:25.941129 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c610cecb-e2fb-4030-a46e-b44d75151c2b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:25.941562 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c610cecb-e2fb-4030-a46e-b44d75151c2b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:26.068638 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c610cecb-e2fb-4030-a46e-b44d75151c2b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:26.077623 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c610cecb-e2fb-4030-a46e-b44d75151c2b tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1314 microversion: 2.1 time: 0.148775 May 10 17:45:26.078318 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 73/139] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:25 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:26.467434 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7f485632-464d-44e9-810a-b69387630166 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:26.467703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f71d3858-d2b0-4274-8d19-cb837c74475e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:26.468383 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7f485632-464d-44e9-810a-b69387630166 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:26.468474 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f71d3858-d2b0-4274-8d19-cb837c74475e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:26.474138 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7f485632-464d-44e9-810a-b69387630166 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:26.474316 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f71d3858-d2b0-4274-8d19-cb837c74475e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:26.474583 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7f485632-464d-44e9-810a-b69387630166 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:26.474681 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f71d3858-d2b0-4274-8d19-cb837c74475e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:26.475352 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f71d3858-d2b0-4274-8d19-cb837c74475e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:26.475469 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7f485632-464d-44e9-810a-b69387630166 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:26.476539 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f71d3858-d2b0-4274-8d19-cb837c74475e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:26.476664 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7f485632-464d-44e9-810a-b69387630166 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:26.673377 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7f485632-464d-44e9-810a-b69387630166 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:26.677660 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f71d3858-d2b0-4274-8d19-cb837c74475e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:26.682004 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7f485632-464d-44e9-810a-b69387630166 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.218506 May 10 17:45:26.682579 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 67/140] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:26 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:26.693469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f71d3858-d2b0-4274-8d19-cb837c74475e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:26.695840 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f71d3858-d2b0-4274-8d19-cb837c74475e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:26.697243 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f71d3858-d2b0-4274-8d19-cb837c74475e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1407 microversion: 2.20 time: 0.233760 May 10 17:45:26.697973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 74/141] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:26 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:26.854439 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-dc135dfa-d1ff-4325-8daa-fc6a256cc4fb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:26.855079 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-dc135dfa-d1ff-4325-8daa-fc6a256cc4fb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:26.861057 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dc135dfa-d1ff-4325-8daa-fc6a256cc4fb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:26.861504 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dc135dfa-d1ff-4325-8daa-fc6a256cc4fb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:26.862270 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dc135dfa-d1ff-4325-8daa-fc6a256cc4fb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:26.862701 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dc135dfa-d1ff-4325-8daa-fc6a256cc4fb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:27.004182 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-dc135dfa-d1ff-4325-8daa-fc6a256cc4fb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:27.012452 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-dc135dfa-d1ff-4325-8daa-fc6a256cc4fb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.161962 May 10 17:45:27.012961 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 68/142] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:26 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:27.095131 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c4e305dc-932c-4abb-b634-4157016bdc50 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:27.095774 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c4e305dc-932c-4abb-b634-4157016bdc50 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:27.101912 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c4e305dc-932c-4abb-b634-4157016bdc50 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:27.102359 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c4e305dc-932c-4abb-b634-4157016bdc50 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:27.103549 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c4e305dc-932c-4abb-b634-4157016bdc50 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:27.103902 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c4e305dc-932c-4abb-b634-4157016bdc50 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:27.263880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c4e305dc-932c-4abb-b634-4157016bdc50 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:27.271389 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c4e305dc-932c-4abb-b634-4157016bdc50 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1314 microversion: 2.1 time: 0.179925 May 10 17:45:27.271973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 75/143] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:27 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:27.474476 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-70fb5326-2599-4297-9e44-1cfa1584687d req-3e3645c6-b1ee-4048-b9d1-fb2a5363fdfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d577a65c-d60c-4d64-a506-89ea984fe255", "name": "network-vif-plugged", "status": "completed", "tag": "bc6ac4c5-c4f8-4e9e-abbf-8071b383eb36"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:45:27.483050 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-70fb5326-2599-4297-9e44-1cfa1584687d req-3e3645c6-b1ee-4048-b9d1-fb2a5363fdfa service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:27.483529 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-70fb5326-2599-4297-9e44-1cfa1584687d req-3e3645c6-b1ee-4048-b9d1-fb2a5363fdfa service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:27.495465 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-70fb5326-2599-4297-9e44-1cfa1584687d req-3e3645c6-b1ee-4048-b9d1-fb2a5363fdfa service nova] Creating event network-vif-plugged:bc6ac4c5-c4f8-4e9e-abbf-8071b383eb36 for instance d577a65c-d60c-4d64-a506-89ea984fe255 on hv-cinder-84130 May 10 17:45:27.502194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-70fb5326-2599-4297-9e44-1cfa1584687d req-3e3645c6-b1ee-4048-b9d1-fb2a5363fdfa service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031186 May 10 17:45:27.503026 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 69/144] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:45:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:45:27.699044 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-085b4945-27d7-4f30-8339-1363e1c9fdea tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:27.699711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-085b4945-27d7-4f30-8339-1363e1c9fdea tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:27.705663 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-085b4945-27d7-4f30-8339-1363e1c9fdea tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:27.706108 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-085b4945-27d7-4f30-8339-1363e1c9fdea tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:27.706872 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-085b4945-27d7-4f30-8339-1363e1c9fdea tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:27.707305 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-085b4945-27d7-4f30-8339-1363e1c9fdea tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:27.715356 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-fe4c0d0f-8ff5-4c87-ab1f-7602fe8249f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:27.716455 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-fe4c0d0f-8ff5-4c87-ab1f-7602fe8249f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:27.722594 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fe4c0d0f-8ff5-4c87-ab1f-7602fe8249f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:27.723074 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fe4c0d0f-8ff5-4c87-ab1f-7602fe8249f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:27.723857 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fe4c0d0f-8ff5-4c87-ab1f-7602fe8249f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:27.724300 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fe4c0d0f-8ff5-4c87-ab1f-7602fe8249f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:27.912962 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-085b4945-27d7-4f30-8339-1363e1c9fdea tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:27.921736 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-085b4945-27d7-4f30-8339-1363e1c9fdea tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.227506 May 10 17:45:27.922364 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 76/145] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:27 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:27.937975 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fe4c0d0f-8ff5-4c87-ab1f-7602fe8249f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:27.946877 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fe4c0d0f-8ff5-4c87-ab1f-7602fe8249f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:27.948434 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fe4c0d0f-8ff5-4c87-ab1f-7602fe8249f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:27.949615 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-fe4c0d0f-8ff5-4c87-ab1f-7602fe8249f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1407 microversion: 2.20 time: 0.238499 May 10 17:45:27.950173 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 70/146] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:27 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:45:28.029910 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8f526e9d-920e-4937-b93c-01c7b63ae704 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:28.030535 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8f526e9d-920e-4937-b93c-01c7b63ae704 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:28.036735 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8f526e9d-920e-4937-b93c-01c7b63ae704 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:28.037181 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8f526e9d-920e-4937-b93c-01c7b63ae704 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:28.037948 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8f526e9d-920e-4937-b93c-01c7b63ae704 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:28.038994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8f526e9d-920e-4937-b93c-01c7b63ae704 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:28.179890 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-8f526e9d-920e-4937-b93c-01c7b63ae704 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:28.184788 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-fbda4b6c-af7a-42b9-8d72-5a15ec7c8084 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "808aa3c0-a3fe-46a1-9d86-cf57d55098d5"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:45:28.186151 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-fbda4b6c-af7a-42b9-8d72-5a15ec7c8084 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:28.188863 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8f526e9d-920e-4937-b93c-01c7b63ae704 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.162875 May 10 17:45:28.189629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 77/147] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:28 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:28.192445 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fbda4b6c-af7a-42b9-8d72-5a15ec7c8084 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:28.192929 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fbda4b6c-af7a-42b9-8d72-5a15ec7c8084 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:28.193705 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fbda4b6c-af7a-42b9-8d72-5a15ec7c8084 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:28.194198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fbda4b6c-af7a-42b9-8d72-5a15ec7c8084 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:28.291049 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-60c303af-c271-4512-889f-ec316dee8722 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:28.291706 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-60c303af-c271-4512-889f-ec316dee8722 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:28.302317 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-60c303af-c271-4512-889f-ec316dee8722 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:28.302772 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-60c303af-c271-4512-889f-ec316dee8722 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:28.304067 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-60c303af-c271-4512-889f-ec316dee8722 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:28.304493 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-60c303af-c271-4512-889f-ec316dee8722 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:28.474275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-60c303af-c271-4512-889f-ec316dee8722 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:28.482973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-60c303af-c271-4512-889f-ec316dee8722 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1314 microversion: 2.1 time: 0.196963 May 10 17:45:28.483796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 78/148] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:28 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:28.943170 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4a6ceb8a-43d6-4ee4-a99b-73c61caa0f39 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:28.945432 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4a6ceb8a-43d6-4ee4-a99b-73c61caa0f39 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:28.957861 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4a6ceb8a-43d6-4ee4-a99b-73c61caa0f39 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:28.959494 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4a6ceb8a-43d6-4ee4-a99b-73c61caa0f39 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:28.961081 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4a6ceb8a-43d6-4ee4-a99b-73c61caa0f39 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:28.962886 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4a6ceb8a-43d6-4ee4-a99b-73c61caa0f39 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:29.177950 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4a6ceb8a-43d6-4ee4-a99b-73c61caa0f39 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:29.193772 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4a6ceb8a-43d6-4ee4-a99b-73c61caa0f39 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.256865 May 10 17:45:29.195274 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 79/149] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:28 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:29.202642 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fd1a9855-e26a-40ed-b44f-ee21ca38091b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:29.203688 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-fd1a9855-e26a-40ed-b44f-ee21ca38091b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:29.233373 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fd1a9855-e26a-40ed-b44f-ee21ca38091b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:29.234341 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fd1a9855-e26a-40ed-b44f-ee21ca38091b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:29.235777 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fd1a9855-e26a-40ed-b44f-ee21ca38091b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:29.236572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fd1a9855-e26a-40ed-b44f-ee21ca38091b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:29.719498 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-fbda4b6c-af7a-42b9-8d72-5a15ec7c8084 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "POST /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.535351 May 10 17:45:29.743242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 71/150] 10.222.0.60 () {60 vars in 1322 bytes} [Tue May 10 17:45:28 2022] POST /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b/os-volume_attachments => generated 194 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:45:29.753050 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5de80650-7571-4fc4-b090-69e7db42f3f7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:29.774784 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5de80650-7571-4fc4-b090-69e7db42f3f7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:29.798193 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5de80650-7571-4fc4-b090-69e7db42f3f7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:29.799649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5de80650-7571-4fc4-b090-69e7db42f3f7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:29.801441 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5de80650-7571-4fc4-b090-69e7db42f3f7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:29.803155 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5de80650-7571-4fc4-b090-69e7db42f3f7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:29.884387 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fd1a9855-e26a-40ed-b44f-ee21ca38091b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:29.899170 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fd1a9855-e26a-40ed-b44f-ee21ca38091b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:29.902852 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fd1a9855-e26a-40ed-b44f-ee21ca38091b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:29.904359 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-fd1a9855-e26a-40ed-b44f-ee21ca38091b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1407 microversion: 2.20 time: 0.705344 May 10 17:45:29.907233 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 80/151] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:29 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1407 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:29.922111 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-39b70ea0-2b5f-4a37-a2bd-814ef5f84876 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:29.923097 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-39b70ea0-2b5f-4a37-a2bd-814ef5f84876 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:29.938092 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-39b70ea0-2b5f-4a37-a2bd-814ef5f84876 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:29.938780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-39b70ea0-2b5f-4a37-a2bd-814ef5f84876 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:29.939975 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-39b70ea0-2b5f-4a37-a2bd-814ef5f84876 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:29.940621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-39b70ea0-2b5f-4a37-a2bd-814ef5f84876 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:30.416214 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-39b70ea0-2b5f-4a37-a2bd-814ef5f84876 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:30.418581 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5de80650-7571-4fc4-b090-69e7db42f3f7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:30.428423 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5de80650-7571-4fc4-b090-69e7db42f3f7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.679712 May 10 17:45:30.438063 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 72/152] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:29 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:30.438063 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bbb2c8fe-1b6d-478d-a751-04d6e3ca116f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:30.438063 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-bbb2c8fe-1b6d-478d-a751-04d6e3ca116f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:30.442782 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-39b70ea0-2b5f-4a37-a2bd-814ef5f84876 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1314 microversion: 2.1 time: 0.534082 May 10 17:45:30.443895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 81/153] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:29 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1314 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:30.447442 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bbb2c8fe-1b6d-478d-a751-04d6e3ca116f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:30.447908 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bbb2c8fe-1b6d-478d-a751-04d6e3ca116f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:30.448717 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bbb2c8fe-1b6d-478d-a751-04d6e3ca116f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:30.449160 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bbb2c8fe-1b6d-478d-a751-04d6e3ca116f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:30.667144 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-bbb2c8fe-1b6d-478d-a751-04d6e3ca116f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:30.678535 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bbb2c8fe-1b6d-478d-a751-04d6e3ca116f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.247913 May 10 17:45:30.680007 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 73/154] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:30 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:30.929398 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-64bb92fb-fa57-41f1-8a42-11a9b4357581 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:30.930120 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-64bb92fb-fa57-41f1-8a42-11a9b4357581 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:30.940856 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-64bb92fb-fa57-41f1-8a42-11a9b4357581 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:30.942198 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-64bb92fb-fa57-41f1-8a42-11a9b4357581 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:30.943344 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-64bb92fb-fa57-41f1-8a42-11a9b4357581 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:30.943739 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-64bb92fb-fa57-41f1-8a42-11a9b4357581 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:31.150838 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-64bb92fb-fa57-41f1-8a42-11a9b4357581 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:31.165324 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-64bb92fb-fa57-41f1-8a42-11a9b4357581 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:31.167822 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-64bb92fb-fa57-41f1-8a42-11a9b4357581 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:31.169837 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-64bb92fb-fa57-41f1-8a42-11a9b4357581 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1407 microversion: 2.20 time: 0.249909 May 10 17:45:31.175408 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 82/155] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:30 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1407 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:31.448570 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8a43acbd-65e4-45f2-9791-469a9451141f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:31.450202 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8a43acbd-65e4-45f2-9791-469a9451141f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:31.461631 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8a43acbd-65e4-45f2-9791-469a9451141f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:31.462220 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8a43acbd-65e4-45f2-9791-469a9451141f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:31.474705 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-6f5a933c-722f-476f-9d29-4058704aecf4 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:31.476039 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-6f5a933c-722f-476f-9d29-4058704aecf4 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:31.479129 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8a43acbd-65e4-45f2-9791-469a9451141f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:31.479864 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8a43acbd-65e4-45f2-9791-469a9451141f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:31.494136 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6f5a933c-722f-476f-9d29-4058704aecf4 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:31.494715 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6f5a933c-722f-476f-9d29-4058704aecf4 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:31.495629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6f5a933c-722f-476f-9d29-4058704aecf4 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:31.496178 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6f5a933c-722f-476f-9d29-4058704aecf4 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:31.786861 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8a43acbd-65e4-45f2-9791-469a9451141f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:31.809794 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8a43acbd-65e4-45f2-9791-469a9451141f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.366524 May 10 17:45:31.810802 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 74/156] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:31 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:31.823107 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5bcb374b-9607-4dc6-89a1-bcf74e343e09 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:31.824005 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5bcb374b-9607-4dc6-89a1-bcf74e343e09 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:31.834921 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5bcb374b-9607-4dc6-89a1-bcf74e343e09 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:31.836570 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5bcb374b-9607-4dc6-89a1-bcf74e343e09 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:31.837924 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5bcb374b-9607-4dc6-89a1-bcf74e343e09 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:31.838536 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5bcb374b-9607-4dc6-89a1-bcf74e343e09 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:31.848964 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6f5a933c-722f-476f-9d29-4058704aecf4 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:31.858627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-6f5a933c-722f-476f-9d29-4058704aecf4 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1314 microversion: 2.1 time: 0.390757 May 10 17:45:31.869603 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 83/157] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:31 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:31.902760 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-fdd1647e-7183-415d-9fb4-fc02505d7a78 req-ae541d5c-591b-4a16-9077-727f73c1afd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4006eed6-2338-46b7-9133-e5c3fdead35c", "name": "network-vif-plugged", "status": "completed", "tag": "e697d9cb-ff2b-45a4-8326-f3219cdf4121"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:45:31.912521 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-fdd1647e-7183-415d-9fb4-fc02505d7a78 req-ae541d5c-591b-4a16-9077-727f73c1afd7 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:31.913382 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-fdd1647e-7183-415d-9fb4-fc02505d7a78 req-ae541d5c-591b-4a16-9077-727f73c1afd7 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:31.928360 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-fdd1647e-7183-415d-9fb4-fc02505d7a78 req-ae541d5c-591b-4a16-9077-727f73c1afd7 service nova] Creating event network-vif-plugged:e697d9cb-ff2b-45a4-8326-f3219cdf4121 for instance 4006eed6-2338-46b7-9133-e5c3fdead35c on hv-cinder-84130 May 10 17:45:31.935104 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-fdd1647e-7183-415d-9fb4-fc02505d7a78 req-ae541d5c-591b-4a16-9077-727f73c1afd7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037303 May 10 17:45:31.936618 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 84/158] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:45:32.057795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5bcb374b-9607-4dc6-89a1-bcf74e343e09 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:32.066092 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5bcb374b-9607-4dc6-89a1-bcf74e343e09 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.253494 May 10 17:45:32.066675 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 75/159] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:31 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:32.196825 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c0788eb0-90ef-4abb-aaf6-7fcb82f40e53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:32.197831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c0788eb0-90ef-4abb-aaf6-7fcb82f40e53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:32.206068 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c0788eb0-90ef-4abb-aaf6-7fcb82f40e53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:32.206905 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c0788eb0-90ef-4abb-aaf6-7fcb82f40e53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:32.208164 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c0788eb0-90ef-4abb-aaf6-7fcb82f40e53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:32.208801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c0788eb0-90ef-4abb-aaf6-7fcb82f40e53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:32.390668 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c0788eb0-90ef-4abb-aaf6-7fcb82f40e53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:32.401129 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c0788eb0-90ef-4abb-aaf6-7fcb82f40e53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:32.404242 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c0788eb0-90ef-4abb-aaf6-7fcb82f40e53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:32.406497 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c0788eb0-90ef-4abb-aaf6-7fcb82f40e53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1407 microversion: 2.20 time: 0.215364 May 10 17:45:32.418860 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 85/160] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:32 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:45:32.831635 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d52091e3-7a5c-4943-beb7-426bcc1462c6 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:32.832571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d52091e3-7a5c-4943-beb7-426bcc1462c6 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:32.845695 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d52091e3-7a5c-4943-beb7-426bcc1462c6 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:32.846889 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d52091e3-7a5c-4943-beb7-426bcc1462c6 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:32.850526 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d52091e3-7a5c-4943-beb7-426bcc1462c6 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:32.853196 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d52091e3-7a5c-4943-beb7-426bcc1462c6 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:32.880331 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7175679e-b2d6-434a-89b7-783bf55d207f tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:32.880942 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7175679e-b2d6-434a-89b7-783bf55d207f tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:32.905412 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7175679e-b2d6-434a-89b7-783bf55d207f tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:32.905971 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7175679e-b2d6-434a-89b7-783bf55d207f tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:32.912533 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7175679e-b2d6-434a-89b7-783bf55d207f tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:32.916037 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7175679e-b2d6-434a-89b7-783bf55d207f tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:33.237374 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d52091e3-7a5c-4943-beb7-426bcc1462c6 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:33.247973 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d52091e3-7a5c-4943-beb7-426bcc1462c6 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.423416 May 10 17:45:33.248702 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 76/161] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:32 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:33.255141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f4f3599b-a0f6-4e0f-9c39-9df8b8147ad1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:33.255935 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f4f3599b-a0f6-4e0f-9c39-9df8b8147ad1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:33.258347 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7175679e-b2d6-434a-89b7-783bf55d207f tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:33.265465 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f4f3599b-a0f6-4e0f-9c39-9df8b8147ad1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:33.268151 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7175679e-b2d6-434a-89b7-783bf55d207f tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1314 microversion: 2.1 time: 0.391959 May 10 17:45:33.268452 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f4f3599b-a0f6-4e0f-9c39-9df8b8147ad1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:33.269347 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 86/162] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:32 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:33.270281 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f4f3599b-a0f6-4e0f-9c39-9df8b8147ad1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:33.270764 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f4f3599b-a0f6-4e0f-9c39-9df8b8147ad1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:33.431699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a0f564c8-08c0-40b1-a2c3-5bd3f2e7a288 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:33.433012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a0f564c8-08c0-40b1-a2c3-5bd3f2e7a288 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:33.443611 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a0f564c8-08c0-40b1-a2c3-5bd3f2e7a288 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:33.445489 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a0f564c8-08c0-40b1-a2c3-5bd3f2e7a288 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:33.447774 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a0f564c8-08c0-40b1-a2c3-5bd3f2e7a288 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:33.448684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a0f564c8-08c0-40b1-a2c3-5bd3f2e7a288 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:33.518412 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f4f3599b-a0f6-4e0f-9c39-9df8b8147ad1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:33.526899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f4f3599b-a0f6-4e0f-9c39-9df8b8147ad1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1322 microversion: 2.1 time: 0.276884 May 10 17:45:33.536735 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 77/163] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:33 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1322 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:33.725518 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a0f564c8-08c0-40b1-a2c3-5bd3f2e7a288 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:33.739460 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a0f564c8-08c0-40b1-a2c3-5bd3f2e7a288 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:33.741623 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a0f564c8-08c0-40b1-a2c3-5bd3f2e7a288 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:33.743195 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a0f564c8-08c0-40b1-a2c3-5bd3f2e7a288 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1407 microversion: 2.20 time: 0.318812 May 10 17:45:33.746035 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 87/164] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:33 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1407 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:34.268149 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d282b215-281c-4cef-b975-ff5fbda99cd9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:34.268971 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d282b215-281c-4cef-b975-ff5fbda99cd9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:34.281270 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d282b215-281c-4cef-b975-ff5fbda99cd9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:34.281911 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d282b215-281c-4cef-b975-ff5fbda99cd9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:34.282840 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d282b215-281c-4cef-b975-ff5fbda99cd9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:34.283846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d282b215-281c-4cef-b975-ff5fbda99cd9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:34.298961 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-143f56d7-cb2a-4f82-a31f-70dc30babe80 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:34.298961 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-143f56d7-cb2a-4f82-a31f-70dc30babe80 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:34.308702 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-143f56d7-cb2a-4f82-a31f-70dc30babe80 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:34.310954 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-143f56d7-cb2a-4f82-a31f-70dc30babe80 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:34.311974 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-143f56d7-cb2a-4f82-a31f-70dc30babe80 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:34.312565 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-143f56d7-cb2a-4f82-a31f-70dc30babe80 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:34.532673 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d282b215-281c-4cef-b975-ff5fbda99cd9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:34.540835 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d282b215-281c-4cef-b975-ff5fbda99cd9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.279227 May 10 17:45:34.541433 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 78/165] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:34 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:34.556868 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1f5c6333-d8fa-4514-bb76-912b5633ac3d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:34.557923 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1f5c6333-d8fa-4514-bb76-912b5633ac3d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:34.564526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-143f56d7-cb2a-4f82-a31f-70dc30babe80 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:34.565076 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1f5c6333-d8fa-4514-bb76-912b5633ac3d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:34.566009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1f5c6333-d8fa-4514-bb76-912b5633ac3d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:34.571499 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1f5c6333-d8fa-4514-bb76-912b5633ac3d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:34.572192 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1f5c6333-d8fa-4514-bb76-912b5633ac3d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:34.577307 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-143f56d7-cb2a-4f82-a31f-70dc30babe80 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1314 microversion: 2.1 time: 0.294906 May 10 17:45:34.578195 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 88/166] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:34 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:34.732943 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1f5c6333-d8fa-4514-bb76-912b5633ac3d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:34.743246 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1f5c6333-d8fa-4514-bb76-912b5633ac3d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1515 microversion: 2.1 time: 0.191619 May 10 17:45:34.744024 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 79/167] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:34 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1515 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:34.767341 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-0e8d248c-e284-4a5f-b405-20e3986fc7e0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:45:34.769246 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-0e8d248c-e284-4a5f-b405-20e3986fc7e0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:34.780243 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0e8d248c-e284-4a5f-b405-20e3986fc7e0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:34.780894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0e8d248c-e284-4a5f-b405-20e3986fc7e0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:34.782599 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0e8d248c-e284-4a5f-b405-20e3986fc7e0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:34.783052 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0e8d248c-e284-4a5f-b405-20e3986fc7e0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:34.784075 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4a1b5d5f-1f18-47f5-ae35-09e2ac42563f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:34.787305 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4a1b5d5f-1f18-47f5-ae35-09e2ac42563f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:34.801620 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4a1b5d5f-1f18-47f5-ae35-09e2ac42563f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:34.802226 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4a1b5d5f-1f18-47f5-ae35-09e2ac42563f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:34.803197 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4a1b5d5f-1f18-47f5-ae35-09e2ac42563f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:34.807422 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4a1b5d5f-1f18-47f5-ae35-09e2ac42563f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:34.877021 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.objects.instance [None req-0e8d248c-e284-4a5f-b405-20e3986fc7e0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lazy-loading 'flavor' on Instance uuid d577a65c-d60c-4d64-a506-89ea984fe255 {{(pid=123753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:45:35.039003 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4a1b5d5f-1f18-47f5-ae35-09e2ac42563f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:35.050252 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4a1b5d5f-1f18-47f5-ae35-09e2ac42563f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:35.052068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4a1b5d5f-1f18-47f5-ae35-09e2ac42563f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:35.053251 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4a1b5d5f-1f18-47f5-ae35-09e2ac42563f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1407 microversion: 2.20 time: 0.282323 May 10 17:45:35.064170 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 80/168] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:34 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1407 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:35.107302 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-0e8d248c-e284-4a5f-b405-20e3986fc7e0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "POST /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255/action" status: 200 len: 32 microversion: 2.1 time: 0.348316 May 10 17:45:35.112830 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 89/169] 10.222.0.60 () {60 vars in 1277 bytes} [Tue May 10 17:45:34 2022] POST /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255/action => generated 32 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:45:35.118419 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f5f4d6f2-ff6a-4bff-ab6a-52c0fb03f839 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:35.119288 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f5f4d6f2-ff6a-4bff-ab6a-52c0fb03f839 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:35.125897 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f5f4d6f2-ff6a-4bff-ab6a-52c0fb03f839 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:35.126689 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f5f4d6f2-ff6a-4bff-ab6a-52c0fb03f839 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:35.127897 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f5f4d6f2-ff6a-4bff-ab6a-52c0fb03f839 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:35.128671 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f5f4d6f2-ff6a-4bff-ab6a-52c0fb03f839 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:35.400743 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f5f4d6f2-ff6a-4bff-ab6a-52c0fb03f839 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:35.414278 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f5f4d6f2-ff6a-4bff-ab6a-52c0fb03f839 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.300264 May 10 17:45:35.415556 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 81/170] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:35 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:35.559815 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a407847b-3999-47f3-b557-a4a4f0019b51 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:35.560614 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a407847b-3999-47f3-b557-a4a4f0019b51 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:35.572984 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a407847b-3999-47f3-b557-a4a4f0019b51 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:35.573441 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a407847b-3999-47f3-b557-a4a4f0019b51 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:35.574231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a407847b-3999-47f3-b557-a4a4f0019b51 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:35.574676 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a407847b-3999-47f3-b557-a4a4f0019b51 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:35.593822 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2debe944-2692-478e-b69b-63f7f61a2191 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:35.594695 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2debe944-2692-478e-b69b-63f7f61a2191 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:35.606844 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2debe944-2692-478e-b69b-63f7f61a2191 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:35.607580 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2debe944-2692-478e-b69b-63f7f61a2191 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:35.608552 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2debe944-2692-478e-b69b-63f7f61a2191 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:35.609151 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2debe944-2692-478e-b69b-63f7f61a2191 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:35.899510 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2debe944-2692-478e-b69b-63f7f61a2191 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:35.906931 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a407847b-3999-47f3-b557-a4a4f0019b51 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:35.915491 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a407847b-3999-47f3-b557-a4a4f0019b51 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.360495 May 10 17:45:35.917469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 90/171] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:35 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:35.918989 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2debe944-2692-478e-b69b-63f7f61a2191 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1314 microversion: 2.1 time: 0.328743 May 10 17:45:35.919890 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 82/172] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:35 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:36.078861 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a6e99c39-8516-4884-a7ba-e183fd41eb9a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:36.085476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a6e99c39-8516-4884-a7ba-e183fd41eb9a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:36.100127 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a6e99c39-8516-4884-a7ba-e183fd41eb9a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:36.103555 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a6e99c39-8516-4884-a7ba-e183fd41eb9a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:36.103555 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a6e99c39-8516-4884-a7ba-e183fd41eb9a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:36.103960 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a6e99c39-8516-4884-a7ba-e183fd41eb9a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:36.299164 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a6e99c39-8516-4884-a7ba-e183fd41eb9a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:36.308249 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a6e99c39-8516-4884-a7ba-e183fd41eb9a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:36.322358 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a6e99c39-8516-4884-a7ba-e183fd41eb9a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:36.325115 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a6e99c39-8516-4884-a7ba-e183fd41eb9a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1407 microversion: 2.20 time: 0.257597 May 10 17:45:36.325746 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 91/173] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:36 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:45:36.437170 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-682f34ed-df03-47cc-abd5-8688e7254d53 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:36.438871 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-682f34ed-df03-47cc-abd5-8688e7254d53 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:36.450720 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-682f34ed-df03-47cc-abd5-8688e7254d53 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:36.451724 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-682f34ed-df03-47cc-abd5-8688e7254d53 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:36.453496 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-682f34ed-df03-47cc-abd5-8688e7254d53 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:36.454559 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-682f34ed-df03-47cc-abd5-8688e7254d53 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:36.602328 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-939399ab-c560-421d-8a92-332e588f8314 req-16e33aa6-3614-49a2-8c04-5722ba236cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539078bb-d792-45a6-ab73-310f58397edc", "name": "network-vif-plugged", "status": "completed", "tag": "2777dc00-4366-4f2e-8110-14038b7477ab"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:45:36.613298 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-939399ab-c560-421d-8a92-332e588f8314 req-16e33aa6-3614-49a2-8c04-5722ba236cca service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:36.614279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-939399ab-c560-421d-8a92-332e588f8314 req-16e33aa6-3614-49a2-8c04-5722ba236cca service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:36.669691 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-939399ab-c560-421d-8a92-332e588f8314 req-16e33aa6-3614-49a2-8c04-5722ba236cca service nova] Creating event network-vif-plugged:2777dc00-4366-4f2e-8110-14038b7477ab for instance 539078bb-d792-45a6-ab73-310f58397edc on hv-cinder-84130 May 10 17:45:36.672867 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-682f34ed-df03-47cc-abd5-8688e7254d53 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:36.681057 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-939399ab-c560-421d-8a92-332e588f8314 req-16e33aa6-3614-49a2-8c04-5722ba236cca service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085078 May 10 17:45:36.683476 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-682f34ed-df03-47cc-abd5-8688e7254d53 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.254624 May 10 17:45:36.684032 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 83/174] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:36 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:36.684708 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 92/175] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:45:36.936641 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5a1540cd-2cf3-4ed3-a9df-a1690ecc7281 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:36.937910 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5a1540cd-2cf3-4ed3-a9df-a1690ecc7281 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:36.943327 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6af180a8-0f26-42ed-a862-4d6e66884881 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:36.957458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6af180a8-0f26-42ed-a862-4d6e66884881 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:36.957562 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5a1540cd-2cf3-4ed3-a9df-a1690ecc7281 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:36.957562 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5a1540cd-2cf3-4ed3-a9df-a1690ecc7281 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:36.957562 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5a1540cd-2cf3-4ed3-a9df-a1690ecc7281 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:36.957562 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5a1540cd-2cf3-4ed3-a9df-a1690ecc7281 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:36.961217 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6af180a8-0f26-42ed-a862-4d6e66884881 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:36.961777 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6af180a8-0f26-42ed-a862-4d6e66884881 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:36.962637 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6af180a8-0f26-42ed-a862-4d6e66884881 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:36.963416 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6af180a8-0f26-42ed-a862-4d6e66884881 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:37.169311 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6af180a8-0f26-42ed-a862-4d6e66884881 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:37.172362 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-5a1540cd-2cf3-4ed3-a9df-a1690ecc7281 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:37.176803 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6af180a8-0f26-42ed-a862-4d6e66884881 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1314 microversion: 2.1 time: 0.237301 May 10 17:45:37.177686 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 84/176] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:36 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:37.180383 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-5a1540cd-2cf3-4ed3-a9df-a1690ecc7281 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.249075 May 10 17:45:37.180945 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 93/177] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:36 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:37.344920 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-fda7003d-0541-4dfe-91d7-c91099f60ba5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:37.345598 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-fda7003d-0541-4dfe-91d7-c91099f60ba5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:37.352396 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fda7003d-0541-4dfe-91d7-c91099f60ba5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:37.352844 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fda7003d-0541-4dfe-91d7-c91099f60ba5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:37.353624 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fda7003d-0541-4dfe-91d7-c91099f60ba5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:37.354059 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fda7003d-0541-4dfe-91d7-c91099f60ba5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:37.505053 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fda7003d-0541-4dfe-91d7-c91099f60ba5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:37.515173 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fda7003d-0541-4dfe-91d7-c91099f60ba5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:37.516724 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fda7003d-0541-4dfe-91d7-c91099f60ba5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:37.518092 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-fda7003d-0541-4dfe-91d7-c91099f60ba5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1407 microversion: 2.20 time: 0.177724 May 10 17:45:37.518668 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 85/178] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:37 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:37.714463 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-aa2de319-a7d4-4f6f-a590-7a57e2b7cd71 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:37.716676 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-aa2de319-a7d4-4f6f-a590-7a57e2b7cd71 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:37.725016 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-aa2de319-a7d4-4f6f-a590-7a57e2b7cd71 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:37.727840 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-aa2de319-a7d4-4f6f-a590-7a57e2b7cd71 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:37.729021 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-aa2de319-a7d4-4f6f-a590-7a57e2b7cd71 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:37.729740 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-aa2de319-a7d4-4f6f-a590-7a57e2b7cd71 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:37.931137 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-aa2de319-a7d4-4f6f-a590-7a57e2b7cd71 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:37.940500 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-aa2de319-a7d4-4f6f-a590-7a57e2b7cd71 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.231770 May 10 17:45:37.942050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 94/179] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:37 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:38.194648 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bdb92550-36f4-4853-84c3-feb425ad4a82 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:38.195387 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-bdb92550-36f4-4853-84c3-feb425ad4a82 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:38.199228 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a19edf16-db93-4cfb-8534-a3e8cddf92df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:38.199883 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a19edf16-db93-4cfb-8534-a3e8cddf92df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:38.202981 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bdb92550-36f4-4853-84c3-feb425ad4a82 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:38.204343 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bdb92550-36f4-4853-84c3-feb425ad4a82 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:38.205230 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bdb92550-36f4-4853-84c3-feb425ad4a82 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:38.206050 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bdb92550-36f4-4853-84c3-feb425ad4a82 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:38.216432 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a19edf16-db93-4cfb-8534-a3e8cddf92df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:38.217236 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a19edf16-db93-4cfb-8534-a3e8cddf92df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:38.225287 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a19edf16-db93-4cfb-8534-a3e8cddf92df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:38.227848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a19edf16-db93-4cfb-8534-a3e8cddf92df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:38.484838 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-bdb92550-36f4-4853-84c3-feb425ad4a82 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:38.486548 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a19edf16-db93-4cfb-8534-a3e8cddf92df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:38.493177 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bdb92550-36f4-4853-84c3-feb425ad4a82 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1314 microversion: 2.1 time: 0.302741 May 10 17:45:38.495109 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 86/180] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:38 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:38.496037 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a19edf16-db93-4cfb-8534-a3e8cddf92df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.300239 May 10 17:45:38.497842 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 95/181] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:38 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:38.546583 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-98453869-4258-4a55-82cd-f8e080416455 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:38.546583 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-98453869-4258-4a55-82cd-f8e080416455 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:38.562369 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98453869-4258-4a55-82cd-f8e080416455 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:38.562881 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98453869-4258-4a55-82cd-f8e080416455 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:38.563699 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98453869-4258-4a55-82cd-f8e080416455 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:38.564146 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98453869-4258-4a55-82cd-f8e080416455 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:38.714087 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-98453869-4258-4a55-82cd-f8e080416455 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:38.723120 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-98453869-4258-4a55-82cd-f8e080416455 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:38.724660 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-98453869-4258-4a55-82cd-f8e080416455 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:38.725883 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-98453869-4258-4a55-82cd-f8e080416455 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1407 microversion: 2.20 time: 0.192647 May 10 17:45:38.726448 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 87/182] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:38 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:45:38.962407 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7e7893f0-64e4-4558-9f07-f0b50b32fa07 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:38.962921 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7e7893f0-64e4-4558-9f07-f0b50b32fa07 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:38.968787 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7e7893f0-64e4-4558-9f07-f0b50b32fa07 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:38.969235 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7e7893f0-64e4-4558-9f07-f0b50b32fa07 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:38.970080 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7e7893f0-64e4-4558-9f07-f0b50b32fa07 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:38.970442 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7e7893f0-64e4-4558-9f07-f0b50b32fa07 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:39.105353 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7e7893f0-64e4-4558-9f07-f0b50b32fa07 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:39.113026 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7e7893f0-64e4-4558-9f07-f0b50b32fa07 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.154667 May 10 17:45:39.113600 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 96/183] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:38 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:39.511230 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-45c938f6-4ae3-48eb-a0c2-168be59d39e4 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:39.512027 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-45c938f6-4ae3-48eb-a0c2-168be59d39e4 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:39.514984 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-0fdf579f-0879-4a11-ab4b-587eba84a00b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:39.515862 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-0fdf579f-0879-4a11-ab4b-587eba84a00b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:39.519947 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-45c938f6-4ae3-48eb-a0c2-168be59d39e4 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:39.520414 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-45c938f6-4ae3-48eb-a0c2-168be59d39e4 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:39.521832 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-45c938f6-4ae3-48eb-a0c2-168be59d39e4 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:39.522998 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-45c938f6-4ae3-48eb-a0c2-168be59d39e4 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:39.524111 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0fdf579f-0879-4a11-ab4b-587eba84a00b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:39.524755 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0fdf579f-0879-4a11-ab4b-587eba84a00b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:39.526188 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0fdf579f-0879-4a11-ab4b-587eba84a00b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:39.526771 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0fdf579f-0879-4a11-ab4b-587eba84a00b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:39.765908 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-0fdf579f-0879-4a11-ab4b-587eba84a00b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:39.775848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-0fdf579f-0879-4a11-ab4b-587eba84a00b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.266049 May 10 17:45:39.777108 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 97/184] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:39 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:39.780898 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-45c938f6-4ae3-48eb-a0c2-168be59d39e4 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:39.792717 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-37dc0be4-f62c-41b0-b09e-4c56721e2ac3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:39.794380 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-37dc0be4-f62c-41b0-b09e-4c56721e2ac3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:39.795843 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-45c938f6-4ae3-48eb-a0c2-168be59d39e4 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1314 microversion: 2.1 time: 0.287358 May 10 17:45:39.802275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-37dc0be4-f62c-41b0-b09e-4c56721e2ac3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:39.802722 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-37dc0be4-f62c-41b0-b09e-4c56721e2ac3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:39.804090 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-37dc0be4-f62c-41b0-b09e-4c56721e2ac3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:39.804921 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-37dc0be4-f62c-41b0-b09e-4c56721e2ac3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:39.805063 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 88/185] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:39 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:40.047472 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-37dc0be4-f62c-41b0-b09e-4c56721e2ac3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:40.065792 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-37dc0be4-f62c-41b0-b09e-4c56721e2ac3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:40.069162 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-37dc0be4-f62c-41b0-b09e-4c56721e2ac3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:40.071875 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-37dc0be4-f62c-41b0-b09e-4c56721e2ac3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1407 microversion: 2.20 time: 0.287953 May 10 17:45:40.072985 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 98/186] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:39 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1407 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:40.132947 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5c79134c-5577-42d5-bc2e-4a3b73288dae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:40.133561 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5c79134c-5577-42d5-bc2e-4a3b73288dae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:40.140643 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5c79134c-5577-42d5-bc2e-4a3b73288dae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:40.141110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5c79134c-5577-42d5-bc2e-4a3b73288dae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:40.141987 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5c79134c-5577-42d5-bc2e-4a3b73288dae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:40.142779 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5c79134c-5577-42d5-bc2e-4a3b73288dae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:40.364122 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5c79134c-5577-42d5-bc2e-4a3b73288dae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:40.388679 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5c79134c-5577-42d5-bc2e-4a3b73288dae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.259746 May 10 17:45:40.391867 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 89/187] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:40 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:40.743116 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4e0292ca-8970-4450-8a10-f426d1b3e7f7 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:40.746933 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4e0292ca-8970-4450-8a10-f426d1b3e7f7 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:40.757205 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e0292ca-8970-4450-8a10-f426d1b3e7f7 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:40.758054 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e0292ca-8970-4450-8a10-f426d1b3e7f7 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:40.759172 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e0292ca-8970-4450-8a10-f426d1b3e7f7 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:40.760024 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e0292ca-8970-4450-8a10-f426d1b3e7f7 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:40.795642 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bb3b859a-5e64-48bc-832b-3a87752014f7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:40.796485 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-bb3b859a-5e64-48bc-832b-3a87752014f7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:40.815994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bb3b859a-5e64-48bc-832b-3a87752014f7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:40.816449 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bb3b859a-5e64-48bc-832b-3a87752014f7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:40.820146 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bb3b859a-5e64-48bc-832b-3a87752014f7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:40.821514 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bb3b859a-5e64-48bc-832b-3a87752014f7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:40.823052 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4e0292ca-8970-4450-8a10-f426d1b3e7f7 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Going to try to terminate instance {{(pid=123753) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:45:41.059004 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4e0292ca-8970-4450-8a10-f426d1b3e7f7 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "DELETE /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 204 len: 0 microversion: 2.1 time: 0.317536 May 10 17:45:41.061369 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 99/188] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:45:40 2022] DELETE /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:45:41.083961 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b2d86fdf-4af2-4d37-aff9-c452e040fea5 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:41.086354 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-b2d86fdf-4af2-4d37-aff9-c452e040fea5 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:41.095843 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b2d86fdf-4af2-4d37-aff9-c452e040fea5 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:41.096665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b2d86fdf-4af2-4d37-aff9-c452e040fea5 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:41.100545 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b2d86fdf-4af2-4d37-aff9-c452e040fea5 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:41.101319 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b2d86fdf-4af2-4d37-aff9-c452e040fea5 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:41.222244 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-bb3b859a-5e64-48bc-832b-3a87752014f7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:41.230925 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bb3b859a-5e64-48bc-832b-3a87752014f7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.440897 May 10 17:45:41.232829 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 90/189] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:40 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:41.240411 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8c82c49f-e873-4e9c-b338-263125f4cbe2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:41.246301 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8c82c49f-e873-4e9c-b338-263125f4cbe2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:41.265582 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8c82c49f-e873-4e9c-b338-263125f4cbe2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:41.266147 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8c82c49f-e873-4e9c-b338-263125f4cbe2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:41.267113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8c82c49f-e873-4e9c-b338-263125f4cbe2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:41.267844 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8c82c49f-e873-4e9c-b338-263125f4cbe2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:41.375084 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b2d86fdf-4af2-4d37-aff9-c452e040fea5 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:41.385885 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b2d86fdf-4af2-4d37-aff9-c452e040fea5 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1314 microversion: 2.1 time: 0.322908 May 10 17:45:41.386724 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 100/190] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:41 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:41.400768 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-91284a5e-911d-49a4-bd44-2d0936283305 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:41.401372 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-91284a5e-911d-49a4-bd44-2d0936283305 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:41.407752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-91284a5e-911d-49a4-bd44-2d0936283305 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:41.408491 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-91284a5e-911d-49a4-bd44-2d0936283305 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:41.409445 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-91284a5e-911d-49a4-bd44-2d0936283305 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:41.410072 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-91284a5e-911d-49a4-bd44-2d0936283305 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:41.447818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8c82c49f-e873-4e9c-b338-263125f4cbe2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:41.457382 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8c82c49f-e873-4e9c-b338-263125f4cbe2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1554 microversion: 2.1 time: 0.220972 May 10 17:45:41.460712 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 91/191] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:41 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1554 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:41.466976 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-f4931f78-bdd6-4165-9b78-d60642201886 req-9785f7ae-a4fa-4579-8034-2b21ba3abe93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35dc394b-a596-4f36-89cf-f60e42d697d1", "name": "network-vif-plugged", "status": "completed", "tag": "6f6bce01-999d-439d-8315-53c87197c824"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:45:41.479516 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-f4931f78-bdd6-4165-9b78-d60642201886 req-9785f7ae-a4fa-4579-8034-2b21ba3abe93 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:41.479884 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-f4931f78-bdd6-4165-9b78-d60642201886 req-9785f7ae-a4fa-4579-8034-2b21ba3abe93 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:41.496820 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-f4931f78-bdd6-4165-9b78-d60642201886 req-9785f7ae-a4fa-4579-8034-2b21ba3abe93 service nova] Creating event network-vif-plugged:6f6bce01-999d-439d-8315-53c87197c824 for instance 35dc394b-a596-4f36-89cf-f60e42d697d1 on hv-cinder-84130 May 10 17:45:41.502755 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-f4931f78-bdd6-4165-9b78-d60642201886 req-9785f7ae-a4fa-4579-8034-2b21ba3abe93 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040384 May 10 17:45:41.507609 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 92/192] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:45:41.513469 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4d9a1f67-3034-4843-9ca0-29fe51735098 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:41.514394 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4d9a1f67-3034-4843-9ca0-29fe51735098 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:41.537805 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4d9a1f67-3034-4843-9ca0-29fe51735098 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:41.539111 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4d9a1f67-3034-4843-9ca0-29fe51735098 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:41.541847 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4d9a1f67-3034-4843-9ca0-29fe51735098 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:41.542654 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4d9a1f67-3034-4843-9ca0-29fe51735098 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:41.623822 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-91284a5e-911d-49a4-bd44-2d0936283305 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:41.635592 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-91284a5e-911d-49a4-bd44-2d0936283305 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:41.637783 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-91284a5e-911d-49a4-bd44-2d0936283305 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:41.639199 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-91284a5e-911d-49a4-bd44-2d0936283305 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1407 microversion: 2.20 time: 0.251310 May 10 17:45:41.639980 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 101/193] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:41 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:41.717499 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4d9a1f67-3034-4843-9ca0-29fe51735098 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:41.726065 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4d9a1f67-3034-4843-9ca0-29fe51735098 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.216548 May 10 17:45:41.727323 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 93/194] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:41 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:42.252022 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-22deee95-9d0d-49ba-9c83-7c349c7561f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:42.253964 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-22deee95-9d0d-49ba-9c83-7c349c7561f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:42.265115 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-22deee95-9d0d-49ba-9c83-7c349c7561f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:42.266164 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-22deee95-9d0d-49ba-9c83-7c349c7561f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:42.267876 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-22deee95-9d0d-49ba-9c83-7c349c7561f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:42.268999 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-22deee95-9d0d-49ba-9c83-7c349c7561f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:42.405834 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5db432c9-aa41-4d91-886f-de58b426fae8 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:42.408667 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5db432c9-aa41-4d91-886f-de58b426fae8 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:42.421721 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5db432c9-aa41-4d91-886f-de58b426fae8 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:42.422870 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5db432c9-aa41-4d91-886f-de58b426fae8 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:42.424432 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5db432c9-aa41-4d91-886f-de58b426fae8 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:42.425378 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5db432c9-aa41-4d91-886f-de58b426fae8 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:42.481382 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-22deee95-9d0d-49ba-9c83-7c349c7561f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:42.509229 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-22deee95-9d0d-49ba-9c83-7c349c7561f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.262703 May 10 17:45:42.515548 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 102/195] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:42 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:42.530259 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-30382d0e-57d4-450f-8167-d6f316d26905 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:42.532881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-30382d0e-57d4-450f-8167-d6f316d26905 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:42.553575 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-30382d0e-57d4-450f-8167-d6f316d26905 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:42.554968 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-30382d0e-57d4-450f-8167-d6f316d26905 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:42.558138 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-30382d0e-57d4-450f-8167-d6f316d26905 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:42.558745 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-30382d0e-57d4-450f-8167-d6f316d26905 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:42.712968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5db432c9-aa41-4d91-886f-de58b426fae8 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:42.723838 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5db432c9-aa41-4d91-886f-de58b426fae8 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1314 microversion: 2.1 time: 0.323212 May 10 17:45:42.725630 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 94/196] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:42 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:42.730869 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2e62e648-b316-4881-ba64-842d804e909b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:42.731803 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2e62e648-b316-4881-ba64-842d804e909b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:42.738083 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e62e648-b316-4881-ba64-842d804e909b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:42.738867 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e62e648-b316-4881-ba64-842d804e909b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:42.740017 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e62e648-b316-4881-ba64-842d804e909b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:42.740552 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e62e648-b316-4881-ba64-842d804e909b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:42.783514 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-30382d0e-57d4-450f-8167-d6f316d26905 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:42.792145 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-30382d0e-57d4-450f-8167-d6f316d26905 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1554 microversion: 2.1 time: 0.273245 May 10 17:45:42.792858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 103/197] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:42 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1554 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:42.798426 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ca59fcb2-89d7-4916-91d1-fcb1a478e68b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:42.799244 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ca59fcb2-89d7-4916-91d1-fcb1a478e68b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:42.807848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ca59fcb2-89d7-4916-91d1-fcb1a478e68b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:42.808565 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ca59fcb2-89d7-4916-91d1-fcb1a478e68b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:42.810096 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ca59fcb2-89d7-4916-91d1-fcb1a478e68b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:42.810735 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ca59fcb2-89d7-4916-91d1-fcb1a478e68b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:42.906544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2e62e648-b316-4881-ba64-842d804e909b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:42.913196 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2e62e648-b316-4881-ba64-842d804e909b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:42.916105 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2e62e648-b316-4881-ba64-842d804e909b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:42.917720 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2e62e648-b316-4881-ba64-842d804e909b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1599 microversion: 2.20 time: 0.190638 May 10 17:45:42.931954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 95/198] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:45:42 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1599 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:45:42.939433 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e2bc957e-ebd3-4f64-877f-c5ce12ab84c2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:42.940094 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e2bc957e-ebd3-4f64-877f-c5ce12ab84c2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:42.948444 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e2bc957e-ebd3-4f64-877f-c5ce12ab84c2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:42.949234 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e2bc957e-ebd3-4f64-877f-c5ce12ab84c2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:42.950226 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e2bc957e-ebd3-4f64-877f-c5ce12ab84c2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:42.950825 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e2bc957e-ebd3-4f64-877f-c5ce12ab84c2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:43.106109 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e2bc957e-ebd3-4f64-877f-c5ce12ab84c2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.171600 May 10 17:45:43.115575 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 96/199] 10.222.0.60 () {60 vars in 1315 bytes} [Tue May 10 17:45:42 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/os-interface => generated 285 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:45:43.220844 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ca59fcb2-89d7-4916-91d1-fcb1a478e68b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:43.232795 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ca59fcb2-89d7-4916-91d1-fcb1a478e68b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.438480 May 10 17:45:43.233750 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 104/200] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:42 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:43.542365 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-92bd113f-2276-4694-85e9-3a35c1c49243 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:43.543034 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-92bd113f-2276-4694-85e9-3a35c1c49243 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:43.560731 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-92bd113f-2276-4694-85e9-3a35c1c49243 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:43.566601 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-92bd113f-2276-4694-85e9-3a35c1c49243 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:43.567478 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-92bd113f-2276-4694-85e9-3a35c1c49243 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:43.567927 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-92bd113f-2276-4694-85e9-3a35c1c49243 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:43.741769 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-0a4551d2-1296-4e02-89f4-aaf8307f2309 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:43.742926 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-0a4551d2-1296-4e02-89f4-aaf8307f2309 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:43.754020 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-92bd113f-2276-4694-85e9-3a35c1c49243 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:43.759541 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0a4551d2-1296-4e02-89f4-aaf8307f2309 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:43.760389 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0a4551d2-1296-4e02-89f4-aaf8307f2309 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:43.764146 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-92bd113f-2276-4694-85e9-3a35c1c49243 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.226465 May 10 17:45:43.768358 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 97/201] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:43 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:43.773439 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0a4551d2-1296-4e02-89f4-aaf8307f2309 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:43.773959 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0a4551d2-1296-4e02-89f4-aaf8307f2309 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:43.810695 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0f36d909-875a-4eb4-ac4e-1f2c28c4cf5f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:43.812014 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0f36d909-875a-4eb4-ac4e-1f2c28c4cf5f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:43.819862 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f36d909-875a-4eb4-ac4e-1f2c28c4cf5f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:43.820896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f36d909-875a-4eb4-ac4e-1f2c28c4cf5f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:43.823046 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f36d909-875a-4eb4-ac4e-1f2c28c4cf5f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:43.824035 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f36d909-875a-4eb4-ac4e-1f2c28c4cf5f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:44.109245 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0f36d909-875a-4eb4-ac4e-1f2c28c4cf5f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:44.123001 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0f36d909-875a-4eb4-ac4e-1f2c28c4cf5f tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1554 microversion: 2.1 time: 0.316475 May 10 17:45:44.124121 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 98/202] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:43 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1554 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:44.130485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-0a4551d2-1296-4e02-89f4-aaf8307f2309 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:44.140233 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-0a4551d2-1296-4e02-89f4-aaf8307f2309 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1464 microversion: 2.1 time: 0.402208 May 10 17:45:44.141581 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 105/203] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:43 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1464 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:44.199887 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-99f128eb-b200-40d1-b6ee-590451a19bd1 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:44.200691 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-99f128eb-b200-40d1-b6ee-590451a19bd1 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:44.215639 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-99f128eb-b200-40d1-b6ee-590451a19bd1 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:44.217002 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-99f128eb-b200-40d1-b6ee-590451a19bd1 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:44.218286 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-99f128eb-b200-40d1-b6ee-590451a19bd1 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:44.218744 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-99f128eb-b200-40d1-b6ee-590451a19bd1 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:44.253180 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-89705637-b630-4e62-8b51-0a1032a8d625 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:44.254206 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-89705637-b630-4e62-8b51-0a1032a8d625 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:44.262440 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-89705637-b630-4e62-8b51-0a1032a8d625 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:44.263565 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-89705637-b630-4e62-8b51-0a1032a8d625 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:44.264629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-89705637-b630-4e62-8b51-0a1032a8d625 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:44.265316 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-89705637-b630-4e62-8b51-0a1032a8d625 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:44.288454 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-99f128eb-b200-40d1-b6ee-590451a19bd1 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:45:44.455451 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-99f128eb-b200-40d1-b6ee-590451a19bd1 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "DELETE /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 204 len: 0 microversion: 2.1 time: 0.261365 May 10 17:45:44.462257 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 99/204] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:45:44 2022] DELETE /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:45:44.481737 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-36ed26bb-c014-4bd0-968d-6bc189a8892d tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:44.484022 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-36ed26bb-c014-4bd0-968d-6bc189a8892d tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:44.497073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-89705637-b630-4e62-8b51-0a1032a8d625 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:44.502038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-36ed26bb-c014-4bd0-968d-6bc189a8892d tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:44.502525 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-36ed26bb-c014-4bd0-968d-6bc189a8892d tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:44.506842 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-36ed26bb-c014-4bd0-968d-6bc189a8892d tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:44.509247 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-36ed26bb-c014-4bd0-968d-6bc189a8892d tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:44.511329 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-89705637-b630-4e62-8b51-0a1032a8d625 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.263776 May 10 17:45:44.512440 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 106/205] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:44 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:44.706318 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-36ed26bb-c014-4bd0-968d-6bc189a8892d tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:44.714551 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-36ed26bb-c014-4bd0-968d-6bc189a8892d tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1470 microversion: 2.1 time: 0.250666 May 10 17:45:44.718178 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 100/206] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:44 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1470 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:44.786010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-69cbcaa8-9078-4f83-8849-564d0a1db29c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:44.786656 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-69cbcaa8-9078-4f83-8849-564d0a1db29c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:44.794975 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-69cbcaa8-9078-4f83-8849-564d0a1db29c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:44.795485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-69cbcaa8-9078-4f83-8849-564d0a1db29c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:44.796287 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-69cbcaa8-9078-4f83-8849-564d0a1db29c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:44.796731 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-69cbcaa8-9078-4f83-8849-564d0a1db29c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:44.973392 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-69cbcaa8-9078-4f83-8849-564d0a1db29c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:44.981269 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-69cbcaa8-9078-4f83-8849-564d0a1db29c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.199403 May 10 17:45:44.981848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 107/207] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:44 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:45.141567 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3b5fb817-0ef7-4954-b4ec-e437aef60d6d tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:45.142126 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3b5fb817-0ef7-4954-b4ec-e437aef60d6d tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:45.148116 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3b5fb817-0ef7-4954-b4ec-e437aef60d6d tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:45.148576 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3b5fb817-0ef7-4954-b4ec-e437aef60d6d tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:45.149358 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3b5fb817-0ef7-4954-b4ec-e437aef60d6d tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:45.149801 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3b5fb817-0ef7-4954-b4ec-e437aef60d6d tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:45.288357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-110eec46-abd6-4095-9c54-986c995c2efa req-0bbd329a-6abd-42e5-ad24-10445be8cf91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4006eed6-2338-46b7-9133-e5c3fdead35c", "tag": "e697d9cb-ff2b-45a4-8326-f3219cdf4121"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:45:45.296446 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-110eec46-abd6-4095-9c54-986c995c2efa req-0bbd329a-6abd-42e5-ad24-10445be8cf91 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:45.296896 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-110eec46-abd6-4095-9c54-986c995c2efa req-0bbd329a-6abd-42e5-ad24-10445be8cf91 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:45.299035 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3b5fb817-0ef7-4954-b4ec-e437aef60d6d tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:45.308225 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-110eec46-abd6-4095-9c54-986c995c2efa req-0bbd329a-6abd-42e5-ad24-10445be8cf91 service nova] Creating event network-changed:e697d9cb-ff2b-45a4-8326-f3219cdf4121 for instance 4006eed6-2338-46b7-9133-e5c3fdead35c on hv-cinder-84130 May 10 17:45:45.308455 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3b5fb817-0ef7-4954-b4ec-e437aef60d6d tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1554 microversion: 2.1 time: 0.170857 May 10 17:45:45.315423 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 101/208] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:45 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:45.315640 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-110eec46-abd6-4095-9c54-986c995c2efa req-0bbd329a-6abd-42e5-ad24-10445be8cf91 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029238 May 10 17:45:45.315640 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 108/209] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:45:45.530678 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d43cd70e-d26e-4cd9-bf3a-b63487ec2663 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:45.531331 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d43cd70e-d26e-4cd9-bf3a-b63487ec2663 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:45.538775 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d43cd70e-d26e-4cd9-bf3a-b63487ec2663 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:45.539708 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d43cd70e-d26e-4cd9-bf3a-b63487ec2663 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:45.540662 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d43cd70e-d26e-4cd9-bf3a-b63487ec2663 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:45.541275 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d43cd70e-d26e-4cd9-bf3a-b63487ec2663 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:45.716642 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d43cd70e-d26e-4cd9-bf3a-b63487ec2663 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:45.725105 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d43cd70e-d26e-4cd9-bf3a-b63487ec2663 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.198159 May 10 17:45:45.726903 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 102/210] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:45 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:45.740440 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fc0cee00-51c3-4495-9a68-b97f0962d2f2 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:45.742342 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-fc0cee00-51c3-4495-9a68-b97f0962d2f2 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:45.749470 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fc0cee00-51c3-4495-9a68-b97f0962d2f2 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:45.750316 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fc0cee00-51c3-4495-9a68-b97f0962d2f2 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:45.751395 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fc0cee00-51c3-4495-9a68-b97f0962d2f2 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:45.752049 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fc0cee00-51c3-4495-9a68-b97f0962d2f2 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:45.940736 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fc0cee00-51c3-4495-9a68-b97f0962d2f2 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:45.949997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-fc0cee00-51c3-4495-9a68-b97f0962d2f2 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1470 microversion: 2.1 time: 0.214513 May 10 17:45:45.950585 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 109/211] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:45 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1470 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:45.998474 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7de9aad9-ec9e-4999-b55c-6e05f464f464 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:45.999303 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7de9aad9-ec9e-4999-b55c-6e05f464f464 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:46.005799 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7de9aad9-ec9e-4999-b55c-6e05f464f464 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:46.006307 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7de9aad9-ec9e-4999-b55c-6e05f464f464 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:46.007551 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7de9aad9-ec9e-4999-b55c-6e05f464f464 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:46.007998 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7de9aad9-ec9e-4999-b55c-6e05f464f464 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:46.159420 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7de9aad9-ec9e-4999-b55c-6e05f464f464 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:46.160447 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7de9aad9-ec9e-4999-b55c-6e05f464f464 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.165970 May 10 17:45:46.161094 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 103/212] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:45 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:46.327280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-3efa7b56-6eb2-41ab-bf56-befc795b7826 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:46.328038 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-3efa7b56-6eb2-41ab-bf56-befc795b7826 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:46.335116 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3efa7b56-6eb2-41ab-bf56-befc795b7826 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:46.336237 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3efa7b56-6eb2-41ab-bf56-befc795b7826 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:46.336387 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3efa7b56-6eb2-41ab-bf56-befc795b7826 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:46.336801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3efa7b56-6eb2-41ab-bf56-befc795b7826 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:46.508781 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-3efa7b56-6eb2-41ab-bf56-befc795b7826 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:46.520967 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-3efa7b56-6eb2-41ab-bf56-befc795b7826 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1554 microversion: 2.1 time: 0.198532 May 10 17:45:46.523300 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 110/213] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:46 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:46.743417 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8ed8a06e-f69f-46ef-a106-c2eaa133279f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:46.743955 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8ed8a06e-f69f-46ef-a106-c2eaa133279f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:46.750343 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8ed8a06e-f69f-46ef-a106-c2eaa133279f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:46.750782 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8ed8a06e-f69f-46ef-a106-c2eaa133279f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:46.751580 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8ed8a06e-f69f-46ef-a106-c2eaa133279f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:46.752030 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8ed8a06e-f69f-46ef-a106-c2eaa133279f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:46.968308 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-0cc47ccf-642f-4b0c-8226-e786f184e4cf tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:46.968890 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-0cc47ccf-642f-4b0c-8226-e786f184e4cf tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:46.975843 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0cc47ccf-642f-4b0c-8226-e786f184e4cf tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:46.976229 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0cc47ccf-642f-4b0c-8226-e786f184e4cf tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:46.977318 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0cc47ccf-642f-4b0c-8226-e786f184e4cf tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:46.977648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0cc47ccf-642f-4b0c-8226-e786f184e4cf tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:47.089381 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8ed8a06e-f69f-46ef-a106-c2eaa133279f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:47.097046 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8ed8a06e-f69f-46ef-a106-c2eaa133279f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.357645 May 10 17:45:47.097947 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 104/214] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:46 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:47.151026 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-0cc47ccf-642f-4b0c-8226-e786f184e4cf tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:47.159033 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-0cc47ccf-642f-4b0c-8226-e786f184e4cf tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1470 microversion: 2.1 time: 0.194969 May 10 17:45:47.159961 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 111/215] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:46 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1470 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:47.178124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-76981e41-99e2-4732-9e62-ba4bfa31d519 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:47.179727 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-76981e41-99e2-4732-9e62-ba4bfa31d519 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:47.186268 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-76981e41-99e2-4732-9e62-ba4bfa31d519 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:47.186860 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-76981e41-99e2-4732-9e62-ba4bfa31d519 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:47.187794 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-76981e41-99e2-4732-9e62-ba4bfa31d519 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:47.188343 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-76981e41-99e2-4732-9e62-ba4bfa31d519 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:47.372952 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-76981e41-99e2-4732-9e62-ba4bfa31d519 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:47.383266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-76981e41-99e2-4732-9e62-ba4bfa31d519 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.208993 May 10 17:45:47.383931 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 105/216] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:47 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:47.538188 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4601e594-7dfe-44de-9369-9353078110b2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:47.539099 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4601e594-7dfe-44de-9369-9353078110b2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:47.546177 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4601e594-7dfe-44de-9369-9353078110b2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:47.546773 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4601e594-7dfe-44de-9369-9353078110b2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:47.547585 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4601e594-7dfe-44de-9369-9353078110b2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:47.548181 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4601e594-7dfe-44de-9369-9353078110b2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:47.752151 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4601e594-7dfe-44de-9369-9353078110b2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:47.762033 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4601e594-7dfe-44de-9369-9353078110b2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1554 microversion: 2.1 time: 0.227705 May 10 17:45:47.763456 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 112/217] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:47 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1554 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:48.114288 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6cc790f0-0fb6-4139-9e4c-13014f633ff0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:48.114798 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6cc790f0-0fb6-4139-9e4c-13014f633ff0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:48.122121 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6cc790f0-0fb6-4139-9e4c-13014f633ff0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:48.122571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6cc790f0-0fb6-4139-9e4c-13014f633ff0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:48.123332 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6cc790f0-0fb6-4139-9e4c-13014f633ff0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:48.123800 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6cc790f0-0fb6-4139-9e4c-13014f633ff0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:48.177813 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a781eda8-dce1-415c-b85b-91dded8b1401 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:48.179062 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a781eda8-dce1-415c-b85b-91dded8b1401 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:48.185720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a781eda8-dce1-415c-b85b-91dded8b1401 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:48.186310 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a781eda8-dce1-415c-b85b-91dded8b1401 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:48.187169 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a781eda8-dce1-415c-b85b-91dded8b1401 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:48.187700 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a781eda8-dce1-415c-b85b-91dded8b1401 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:48.301915 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6cc790f0-0fb6-4139-9e4c-13014f633ff0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:48.311041 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6cc790f0-0fb6-4139-9e4c-13014f633ff0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.200707 May 10 17:45:48.311792 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 106/218] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:48 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:48.354260 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a781eda8-dce1-415c-b85b-91dded8b1401 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:48.361988 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a781eda8-dce1-415c-b85b-91dded8b1401 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1470 microversion: 2.1 time: 0.187993 May 10 17:45:48.362564 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 113/219] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:48 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1470 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:48.400866 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0747fab4-e19f-449a-9f63-4fc6737a7cb5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:48.401473 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0747fab4-e19f-449a-9f63-4fc6737a7cb5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:48.407547 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0747fab4-e19f-449a-9f63-4fc6737a7cb5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:48.408000 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0747fab4-e19f-449a-9f63-4fc6737a7cb5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:48.408764 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0747fab4-e19f-449a-9f63-4fc6737a7cb5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:48.409198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0747fab4-e19f-449a-9f63-4fc6737a7cb5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:48.547610 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0747fab4-e19f-449a-9f63-4fc6737a7cb5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:48.555757 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0747fab4-e19f-449a-9f63-4fc6737a7cb5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.159165 May 10 17:45:48.556325 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 107/220] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:48 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:48.781553 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-14e160f2-f97e-49dd-b804-08dd57cf6e04 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:48.782586 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-14e160f2-f97e-49dd-b804-08dd57cf6e04 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:48.792161 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-14e160f2-f97e-49dd-b804-08dd57cf6e04 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:48.792860 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-14e160f2-f97e-49dd-b804-08dd57cf6e04 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:48.793876 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-14e160f2-f97e-49dd-b804-08dd57cf6e04 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:48.794677 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-14e160f2-f97e-49dd-b804-08dd57cf6e04 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:48.980665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-14e160f2-f97e-49dd-b804-08dd57cf6e04 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:48.989250 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-14e160f2-f97e-49dd-b804-08dd57cf6e04 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1554 microversion: 2.1 time: 0.212095 May 10 17:45:48.990316 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 114/221] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:48 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1554 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:49.330999 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-249b720d-33b9-49b6-820c-cbf7125ecf40 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:49.331830 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-249b720d-33b9-49b6-820c-cbf7125ecf40 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:49.340106 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-249b720d-33b9-49b6-820c-cbf7125ecf40 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:49.340929 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-249b720d-33b9-49b6-820c-cbf7125ecf40 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:49.341897 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-249b720d-33b9-49b6-820c-cbf7125ecf40 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:49.342520 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-249b720d-33b9-49b6-820c-cbf7125ecf40 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:49.384782 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-92cc9ff9-ae66-45c8-a4c3-224540bab33c tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:49.389841 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-92cc9ff9-ae66-45c8-a4c3-224540bab33c tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:49.415076 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-92cc9ff9-ae66-45c8-a4c3-224540bab33c tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:49.427409 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-92cc9ff9-ae66-45c8-a4c3-224540bab33c tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:49.427409 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-92cc9ff9-ae66-45c8-a4c3-224540bab33c tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:49.427409 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-92cc9ff9-ae66-45c8-a4c3-224540bab33c tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:49.585950 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-249b720d-33b9-49b6-820c-cbf7125ecf40 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:49.606559 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-249b720d-33b9-49b6-820c-cbf7125ecf40 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.277481 May 10 17:45:49.607606 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 108/222] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:49 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:49.612942 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7b0b947e-af78-4fa4-ac40-04cf8d24d01c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:49.613889 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7b0b947e-af78-4fa4-ac40-04cf8d24d01c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:49.622697 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b0b947e-af78-4fa4-ac40-04cf8d24d01c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:49.623784 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b0b947e-af78-4fa4-ac40-04cf8d24d01c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:49.625410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b0b947e-af78-4fa4-ac40-04cf8d24d01c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:49.626332 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b0b947e-af78-4fa4-ac40-04cf8d24d01c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:49.669751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-92cc9ff9-ae66-45c8-a4c3-224540bab33c tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:49.679777 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-92cc9ff9-ae66-45c8-a4c3-224540bab33c tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1470 microversion: 2.1 time: 0.303366 May 10 17:45:49.690239 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 115/223] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:49 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1470 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:49.800236 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7b0b947e-af78-4fa4-ac40-04cf8d24d01c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:49.808290 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7b0b947e-af78-4fa4-ac40-04cf8d24d01c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1364 microversion: 2.1 time: 0.199398 May 10 17:45:49.808884 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 109/224] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:49 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:50.011665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8f79e198-9d3d-45dd-8acf-d16f8df8fdbe tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:50.012284 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8f79e198-9d3d-45dd-8acf-d16f8df8fdbe tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:50.018720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8f79e198-9d3d-45dd-8acf-d16f8df8fdbe tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:50.019192 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8f79e198-9d3d-45dd-8acf-d16f8df8fdbe tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:50.020591 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8f79e198-9d3d-45dd-8acf-d16f8df8fdbe tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:50.021042 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8f79e198-9d3d-45dd-8acf-d16f8df8fdbe tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:50.192982 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-8f79e198-9d3d-45dd-8acf-d16f8df8fdbe tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:50.203238 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8f79e198-9d3d-45dd-8acf-d16f8df8fdbe tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1554 microversion: 2.1 time: 0.197046 May 10 17:45:50.213241 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 116/225] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:50 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1554 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:50.628500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cab02fdb-6cf9-461e-8a0d-00514e6202be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:50.629824 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cab02fdb-6cf9-461e-8a0d-00514e6202be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:50.650162 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cab02fdb-6cf9-461e-8a0d-00514e6202be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:50.650791 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cab02fdb-6cf9-461e-8a0d-00514e6202be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:50.651776 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cab02fdb-6cf9-461e-8a0d-00514e6202be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:50.652378 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cab02fdb-6cf9-461e-8a0d-00514e6202be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:50.701292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1986025e-ba18-4157-9f9a-fe8662db310e tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:50.702644 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-1986025e-ba18-4157-9f9a-fe8662db310e tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:50.720462 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1986025e-ba18-4157-9f9a-fe8662db310e tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:50.722481 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1986025e-ba18-4157-9f9a-fe8662db310e tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:50.724751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1986025e-ba18-4157-9f9a-fe8662db310e tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:50.725297 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1986025e-ba18-4157-9f9a-fe8662db310e tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:50.926046 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1986025e-ba18-4157-9f9a-fe8662db310e tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '552433b497424e6fab5e83a5b3887d61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29260c09fcef4a49a7f9b244feca77cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:50.935403 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cab02fdb-6cf9-461e-8a0d-00514e6202be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:50.939902 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-1986025e-ba18-4157-9f9a-fe8662db310e tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 200 len: 1428 microversion: 2.1 time: 0.246524 May 10 17:45:50.940869 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 117/226] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:50 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 1428 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:50.947071 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cab02fdb-6cf9-461e-8a0d-00514e6202be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.323649 May 10 17:45:50.948187 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 110/227] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:50 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:50.954747 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-db3e3e97-dfb5-4dd5-8407-14f1b9301bc1 req-93829eea-0526-42f4-803b-9e42d464128d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "539078bb-d792-45a6-ab73-310f58397edc", "name": "network-vif-deleted", "tag": "2777dc00-4366-4f2e-8110-14038b7477ab"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:45:50.961451 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-d21381bb-afb8-4431-9197-b919df90b29e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:50.962082 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-d21381bb-afb8-4431-9197-b919df90b29e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:50.966628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-db3e3e97-dfb5-4dd5-8407-14f1b9301bc1 req-93829eea-0526-42f4-803b-9e42d464128d service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:50.968361 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-db3e3e97-dfb5-4dd5-8407-14f1b9301bc1 req-93829eea-0526-42f4-803b-9e42d464128d service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:50.969606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d21381bb-afb8-4431-9197-b919df90b29e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:50.970060 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d21381bb-afb8-4431-9197-b919df90b29e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:50.970917 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d21381bb-afb8-4431-9197-b919df90b29e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:50.971690 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d21381bb-afb8-4431-9197-b919df90b29e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:50.985864 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-db3e3e97-dfb5-4dd5-8407-14f1b9301bc1 req-93829eea-0526-42f4-803b-9e42d464128d service nova] Creating event network-vif-deleted:2777dc00-4366-4f2e-8110-14038b7477ab for instance 539078bb-d792-45a6-ab73-310f58397edc on hv-cinder-84130 May 10 17:45:50.992757 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-db3e3e97-dfb5-4dd5-8407-14f1b9301bc1 req-93829eea-0526-42f4-803b-9e42d464128d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043130 May 10 17:45:50.994498 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 111/228] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:45:51.221697 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-78d3b623-05f5-42a8-9bb3-0a6c6ffc8dd4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:51.223399 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-78d3b623-05f5-42a8-9bb3-0a6c6ffc8dd4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:51.244780 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-78d3b623-05f5-42a8-9bb3-0a6c6ffc8dd4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:51.247226 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-78d3b623-05f5-42a8-9bb3-0a6c6ffc8dd4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:51.248720 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-78d3b623-05f5-42a8-9bb3-0a6c6ffc8dd4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:51.250288 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-78d3b623-05f5-42a8-9bb3-0a6c6ffc8dd4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:51.267351 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-d21381bb-afb8-4431-9197-b919df90b29e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:51.280069 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-d21381bb-afb8-4431-9197-b919df90b29e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1555 microversion: 2.1 time: 0.334215 May 10 17:45:51.280866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 118/229] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:50 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1555 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:51.298777 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-70ff20b9-34c6-4489-9476-ef71fe435413 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:51.299276 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-70ff20b9-34c6-4489-9476-ef71fe435413 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:51.305547 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-70ff20b9-34c6-4489-9476-ef71fe435413 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:51.306232 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-70ff20b9-34c6-4489-9476-ef71fe435413 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:51.307188 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-70ff20b9-34c6-4489-9476-ef71fe435413 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:51.307843 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-70ff20b9-34c6-4489-9476-ef71fe435413 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:51.525193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-70ff20b9-34c6-4489-9476-ef71fe435413 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.230236 May 10 17:45:51.525695 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 119/230] 10.222.0.60 () {58 vars in 1274 bytes} [Tue May 10 17:45:51 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1/os-interface => generated 285 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:45:51.590717 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-78d3b623-05f5-42a8-9bb3-0a6c6ffc8dd4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:51.601136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-78d3b623-05f5-42a8-9bb3-0a6c6ffc8dd4 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1554 microversion: 2.1 time: 0.383727 May 10 17:45:51.602364 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 112/231] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:51 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1554 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:45:51.960235 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1104144c-f7d3-4ca0-8a74-d0a46d60cae9 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:51.961032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-1104144c-f7d3-4ca0-8a74-d0a46d60cae9 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] [instance: 539078bb-d792-45a6-ab73-310f58397edc] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:51.965659 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-de196bd6-200e-4a71-b3a8-817a3d20e266 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:51.967757 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-de196bd6-200e-4a71-b3a8-817a3d20e266 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:51.971772 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1104144c-f7d3-4ca0-8a74-d0a46d60cae9 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:51.977328 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1104144c-f7d3-4ca0-8a74-d0a46d60cae9 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:51.979847 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1104144c-f7d3-4ca0-8a74-d0a46d60cae9 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:51.980308 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1104144c-f7d3-4ca0-8a74-d0a46d60cae9 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:52.008615 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-de196bd6-200e-4a71-b3a8-817a3d20e266 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:52.008966 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-de196bd6-200e-4a71-b3a8-817a3d20e266 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:52.010955 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-de196bd6-200e-4a71-b3a8-817a3d20e266 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:52.014274 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-de196bd6-200e-4a71-b3a8-817a3d20e266 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:52.019103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-1104144c-f7d3-4ca0-8a74-d0a46d60cae9 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] HTTP exception thrown: Instance 539078bb-d792-45a6-ab73-310f58397edc could not be found. May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1104144c-f7d3-4ca0-8a74-d0a46d60cae9 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Request method failure captured: May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc HTTP/1.1 May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqSjVQQ1iHpM8PpVC2sM7cnCKdKNic3QyFaipq9Evzn5ytZqp-LtaVp4WUfRNYSc6B4D-bHlSGC0dpq1jcb0j-V_cpGiV3qRf8JkEvYH2dUYpugv2HtvivGVIAnKcfMMiSUBUELIESD4uBuTKniP34fomtDT9TVg5H5cqqkWv6vRzL0 May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: 29260c09fcef4a49a7f9b244feca77cb May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-VolumesNegativeTest-2103617696 May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:45:52.030685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:45:52.032973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29260c09fcef4a49a7f9b244feca77cb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/29260c09fcef4a49a7f9b244feca77cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_29260c09fcef4a49a7f9b244feca77cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/29260c09fcef4a49a7f9b244feca77cb"}]}] May 10 17:45:52.032973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-VolumesNegativeTest-2103617696 May 10 17:45:52.032973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: 29260c09fcef4a49a7f9b244feca77cb May 10 17:45:52.032973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-VolumesNegativeTest-2103617696 May 10 17:45:52.032973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-VolumesNegativeTest-2103617696-project May 10 17:45:52.032973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:45:52.032973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:45:52.032973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: 552433b497424e6fab5e83a5b3887d61 May 10 17:45:52.032973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-VolumesNegativeTest-2103617696-project May 10 17:45:52.032973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:45:52.032973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance 539078bb-d792-45a6-ab73-310f58397edc could not be found. May 10 17:45:52.032973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': '539078bb-d792-45a6-ab73-310f58397edc'} May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 539078bb-d792-45a6-ab73-310f58397edc could not be found. May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:45:52.034073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:45:52.037261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:45:52.037261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:45:52.037261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:45:52.037261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:45:52.037261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:45:52.037261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:45:52.037261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:45:52.037261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 539078bb-d792-45a6-ab73-310f58397edc could not be found. May 10 17:45:52.037261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:45:52.037261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:45:52.037261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:45:52.037261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:45:52.037261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:45:52.037261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:45:52.037261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:45:52.037261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:45:52.037261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 539078bb-d792-45a6-ab73-310f58397edc could not be found. May 10 17:45:52.037261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:45:52.050546 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1104144c-f7d3-4ca0-8a74-d0a46d60cae9 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] Returning 404 to user: Instance 539078bb-d792-45a6-ab73-310f58397edc could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:45:52.053624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-1104144c-f7d3-4ca0-8a74-d0a46d60cae9 tempest-VolumesNegativeTest-2103617696 tempest-VolumesNegativeTest-2103617696-project] 10.222.0.60 "GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc" status: 404 len: 111 microversion: 2.1 time: 0.098026 May 10 17:45:52.054442 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 120/232] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:51 2022] GET /compute/v2.1/servers/539078bb-d792-45a6-ab73-310f58397edc => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:45:52.344918 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-de196bd6-200e-4a71-b3a8-817a3d20e266 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:52.363307 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-de196bd6-200e-4a71-b3a8-817a3d20e266 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.402697 May 10 17:45:52.368846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 113/233] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:51 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:52.519921 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-ecaf2344-5f79-46f3-be78-b9b92b7517f4 req-242c155b-e3dc-45d4-8055-f2ae5fe7df6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd7903d-232c-4666-939c-eb22c6fbf01b", "name": "network-vif-deleted", "tag": "dee56dfb-cae2-41f9-b79a-5dd4e4a84d7f"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:45:52.534337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-ecaf2344-5f79-46f3-be78-b9b92b7517f4 req-242c155b-e3dc-45d4-8055-f2ae5fe7df6e service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:52.534790 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-ecaf2344-5f79-46f3-be78-b9b92b7517f4 req-242c155b-e3dc-45d4-8055-f2ae5fe7df6e service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:52.565652 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-ecaf2344-5f79-46f3-be78-b9b92b7517f4 req-242c155b-e3dc-45d4-8055-f2ae5fe7df6e service nova] Creating event network-vif-deleted:dee56dfb-cae2-41f9-b79a-5dd4e4a84d7f for instance acd7903d-232c-4666-939c-eb22c6fbf01b on hv-cinder-84130 May 10 17:45:52.578415 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-ecaf2344-5f79-46f3-be78-b9b92b7517f4 req-242c155b-e3dc-45d4-8055-f2ae5fe7df6e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063465 May 10 17:45:52.579076 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 121/234] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:45:52.620805 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7697f0e1-5a13-409c-bb50-695f1c7c81a3 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:52.621673 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7697f0e1-5a13-409c-bb50-695f1c7c81a3 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:52.633270 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7697f0e1-5a13-409c-bb50-695f1c7c81a3 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:52.637619 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7697f0e1-5a13-409c-bb50-695f1c7c81a3 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:52.638721 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7697f0e1-5a13-409c-bb50-695f1c7c81a3 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:52.639280 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7697f0e1-5a13-409c-bb50-695f1c7c81a3 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:52.778106 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7697f0e1-5a13-409c-bb50-695f1c7c81a3 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca6c3d8d36db4f5fbc6c24834f81f599', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98c641670665465caa49f5d709911793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:52.788184 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7697f0e1-5a13-409c-bb50-695f1c7c81a3 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 200 len: 1346 microversion: 2.1 time: 0.173155 May 10 17:45:52.789513 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 114/235] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:52 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 1346 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:53.388386 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-89db10a6-479d-4bbc-9920-52d7e3e1c93e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:53.389992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-89db10a6-479d-4bbc-9920-52d7e3e1c93e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:53.399886 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-89db10a6-479d-4bbc-9920-52d7e3e1c93e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:53.400497 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-89db10a6-479d-4bbc-9920-52d7e3e1c93e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:53.401457 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-89db10a6-479d-4bbc-9920-52d7e3e1c93e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:53.401861 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-89db10a6-479d-4bbc-9920-52d7e3e1c93e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:53.632792 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-89db10a6-479d-4bbc-9920-52d7e3e1c93e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:53.648658 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-89db10a6-479d-4bbc-9920-52d7e3e1c93e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.264774 May 10 17:45:53.657929 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 122/236] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:53 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:53.676036 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-74dfeeb6-1862-4eae-8568-7c6a531ebc03 req-8639c34b-31fe-4c9c-8d11-e68a9ab5e326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35dc394b-a596-4f36-89cf-f60e42d697d1", "tag": "6f6bce01-999d-439d-8315-53c87197c824"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:45:53.726748 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-74dfeeb6-1862-4eae-8568-7c6a531ebc03 req-8639c34b-31fe-4c9c-8d11-e68a9ab5e326 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:53.731988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-74dfeeb6-1862-4eae-8568-7c6a531ebc03 req-8639c34b-31fe-4c9c-8d11-e68a9ab5e326 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:53.806437 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-13536a0b-9e74-43d6-9653-47dd79fd5ce2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:53.807700 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-13536a0b-9e74-43d6-9653-47dd79fd5ce2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:53.823308 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-13536a0b-9e74-43d6-9653-47dd79fd5ce2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:53.828949 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-74dfeeb6-1862-4eae-8568-7c6a531ebc03 req-8639c34b-31fe-4c9c-8d11-e68a9ab5e326 service nova] Creating event network-changed:6f6bce01-999d-439d-8315-53c87197c824 for instance 35dc394b-a596-4f36-89cf-f60e42d697d1 on hv-cinder-84130 May 10 17:45:53.830047 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-13536a0b-9e74-43d6-9653-47dd79fd5ce2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:53.835170 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-13536a0b-9e74-43d6-9653-47dd79fd5ce2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:53.835781 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-13536a0b-9e74-43d6-9653-47dd79fd5ce2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:53.845984 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-74dfeeb6-1862-4eae-8568-7c6a531ebc03 req-8639c34b-31fe-4c9c-8d11-e68a9ab5e326 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181697 May 10 17:45:53.846803 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 115/237] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:45:53.924532 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-13536a0b-9e74-43d6-9653-47dd79fd5ce2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] HTTP exception thrown: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-13536a0b-9e74-43d6-9653-47dd79fd5ce2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Request method failure captured: May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b HTTP/1.1 May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqR_ko40GAljnN5lz-sXd2WMhsClU_7QrHB7rf499sjyJ24Ebg5cVxEWEXbo-GDo-oibCqaq8kWC-TEj7cDNtQV0sUZl2a8PtacP1Lp5iC1u0D32G_KFoF6KqMbgtYjVWo89HshdgUsSqhQBpk-hCHBx8WFqEN4kOA47jRPL8ZkfSeA May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: 98c641670665465caa49f5d709911793 May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-DeleteServersTestJSON-636381056 May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:45:53.926997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:45:53.929907 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98c641670665465caa49f5d709911793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/98c641670665465caa49f5d709911793"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_98c641670665465caa49f5d709911793"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98c641670665465caa49f5d709911793"}]}] May 10 17:45:53.929907 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-DeleteServersTestJSON-636381056 May 10 17:45:53.929907 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: 98c641670665465caa49f5d709911793 May 10 17:45:53.929907 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-DeleteServersTestJSON-636381056 May 10 17:45:53.929907 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-DeleteServersTestJSON-636381056-project May 10 17:45:53.929907 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:45:53.929907 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:45:53.929907 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: ca6c3d8d36db4f5fbc6c24834f81f599 May 10 17:45:53.929907 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-DeleteServersTestJSON-636381056-project May 10 17:45:53.929907 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:45:53.929907 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:53.929907 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': 'acd7903d-232c-4666-939c-eb22c6fbf01b'} May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:45:53.930711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:45:53.932050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:45:53.932050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:45:53.932050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:45:53.932050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:45:53.932050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:45:53.932050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:45:53.932050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:45:53.932050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:53.932050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:45:53.932050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:45:53.932050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:45:53.932050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:45:53.932050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:45:53.932050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:45:53.932050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:45:53.932050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:45:53.932050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:53.932050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:45:53.933103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-13536a0b-9e74-43d6-9653-47dd79fd5ce2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Returning 404 to user: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:45:53.933998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-13536a0b-9e74-43d6-9653-47dd79fd5ce2 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 404 len: 111 microversion: 2.1 time: 0.131723 May 10 17:45:53.936048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 123/238] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:53 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:45:54.106580 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ca1cdcea-3fc0-4987-92cb-df03d678b865 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:54.107791 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ca1cdcea-3fc0-4987-92cb-df03d678b865 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:54.124510 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ca1cdcea-3fc0-4987-92cb-df03d678b865 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:54.125051 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ca1cdcea-3fc0-4987-92cb-df03d678b865 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:54.125773 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ca1cdcea-3fc0-4987-92cb-df03d678b865 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:54.126218 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ca1cdcea-3fc0-4987-92cb-df03d678b865 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:54.167499 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-ca1cdcea-3fc0-4987-92cb-df03d678b865 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] HTTP exception thrown: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ca1cdcea-3fc0-4987-92cb-df03d678b865 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Request method failure captured: May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b/os-volume_attachments HTTP/1.1 May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqR_ko40GAljnN5lz-sXd2WMhsClU_7QrHB7rf499sjyJ24Ebg5cVxEWEXbo-GDo-oibCqaq8kWC-TEj7cDNtQV0sUZl2a8PtacP1Lp5iC1u0D32G_KFoF6KqMbgtYjVWo89HshdgUsSqhQBpk-hCHBx8WFqEN4kOA47jRPL8ZkfSeA May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: 98c641670665465caa49f5d709911793 May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-DeleteServersTestJSON-636381056 May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:45:54.179136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:45:54.180544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98c641670665465caa49f5d709911793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/98c641670665465caa49f5d709911793"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_98c641670665465caa49f5d709911793"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98c641670665465caa49f5d709911793"}]}] May 10 17:45:54.180544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-DeleteServersTestJSON-636381056 May 10 17:45:54.180544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 98c641670665465caa49f5d709911793 May 10 17:45:54.180544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-DeleteServersTestJSON-636381056 May 10 17:45:54.180544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-DeleteServersTestJSON-636381056-project May 10 17:45:54.180544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:45:54.180544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:45:54.180544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: ca6c3d8d36db4f5fbc6c24834f81f599 May 10 17:45:54.180544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-DeleteServersTestJSON-636381056-project May 10 17:45:54.180544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:45:54.180544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:54.180544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'server_id': 'acd7903d-232c-4666-939c-eb22c6fbf01b'} May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:45:54.181194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:54.182242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:45:54.190440 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ca1cdcea-3fc0-4987-92cb-df03d678b865 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Returning 404 to user: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:45:54.192690 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ca1cdcea-3fc0-4987-92cb-df03d678b865 tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.090773 May 10 17:45:54.197320 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 116/239] 10.222.0.60 () {58 vars in 1301 bytes} [Tue May 10 17:45:54 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b/os-volume_attachments => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:45:54.673837 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-d9b4ff71-bf07-4bc9-b014-db106b89d7d4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:54.674946 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-d9b4ff71-bf07-4bc9-b014-db106b89d7d4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:54.688910 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d9b4ff71-bf07-4bc9-b014-db106b89d7d4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:54.690339 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d9b4ff71-bf07-4bc9-b014-db106b89d7d4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:54.692491 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d9b4ff71-bf07-4bc9-b014-db106b89d7d4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:54.693660 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d9b4ff71-bf07-4bc9-b014-db106b89d7d4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:55.138664 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-d9b4ff71-bf07-4bc9-b014-db106b89d7d4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:55.155493 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-d9b4ff71-bf07-4bc9-b014-db106b89d7d4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.491400 May 10 17:45:55.156945 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 124/240] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:54 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:55.633238 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6881553b-72f6-4bad-ba8a-46e9fdd2eacc tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:55.634634 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6881553b-72f6-4bad-ba8a-46e9fdd2eacc tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:55.655624 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6881553b-72f6-4bad-ba8a-46e9fdd2eacc tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:55.656399 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6881553b-72f6-4bad-ba8a-46e9fdd2eacc tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:55.658519 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6881553b-72f6-4bad-ba8a-46e9fdd2eacc tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:55.659829 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6881553b-72f6-4bad-ba8a-46e9fdd2eacc tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:55.687261 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-6881553b-72f6-4bad-ba8a-46e9fdd2eacc tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] HTTP exception thrown: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6881553b-72f6-4bad-ba8a-46e9fdd2eacc tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Request method failure captured: May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: DELETE /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b HTTP/1.1 May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqR_ko40GAljnN5lz-sXd2WMhsClU_7QrHB7rf499sjyJ24Ebg5cVxEWEXbo-GDo-oibCqaq8kWC-TEj7cDNtQV0sUZl2a8PtacP1Lp5iC1u0D32G_KFoF6KqMbgtYjVWo89HshdgUsSqhQBpk-hCHBx8WFqEN4kOA47jRPL8ZkfSeA May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: 98c641670665465caa49f5d709911793 May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-DeleteServersTestJSON-636381056 May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:45:55.691130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:45:55.692542 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98c641670665465caa49f5d709911793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/98c641670665465caa49f5d709911793"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_98c641670665465caa49f5d709911793"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98c641670665465caa49f5d709911793"}]}] May 10 17:45:55.692542 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-DeleteServersTestJSON-636381056 May 10 17:45:55.692542 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 98c641670665465caa49f5d709911793 May 10 17:45:55.692542 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-DeleteServersTestJSON-636381056 May 10 17:45:55.692542 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-DeleteServersTestJSON-636381056-project May 10 17:45:55.692542 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:45:55.692542 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:45:55.692542 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: ca6c3d8d36db4f5fbc6c24834f81f599 May 10 17:45:55.692542 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-DeleteServersTestJSON-636381056-project May 10 17:45:55.692542 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:45:55.692542 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:55.692542 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': 'acd7903d-232c-4666-939c-eb22c6fbf01b'} May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:45:55.693330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:55.694807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:45:55.698035 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6881553b-72f6-4bad-ba8a-46e9fdd2eacc tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Returning 404 to user: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:45:55.699380 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6881553b-72f6-4bad-ba8a-46e9fdd2eacc tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "DELETE /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 404 len: 111 microversion: 2.1 time: 0.072958 May 10 17:45:55.700681 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 117/241] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:45:55 2022] DELETE /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:45:55.710923 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8a72144d-d870-4f0c-82f7-6442e111133a tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:55.712379 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8a72144d-d870-4f0c-82f7-6442e111133a tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] [instance: acd7903d-232c-4666-939c-eb22c6fbf01b] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:55.722792 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8a72144d-d870-4f0c-82f7-6442e111133a tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:55.723650 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8a72144d-d870-4f0c-82f7-6442e111133a tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:55.724584 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8a72144d-d870-4f0c-82f7-6442e111133a tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:55.727234 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8a72144d-d870-4f0c-82f7-6442e111133a tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:55.754944 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-8a72144d-d870-4f0c-82f7-6442e111133a tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] HTTP exception thrown: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8a72144d-d870-4f0c-82f7-6442e111133a tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Request method failure captured: May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b HTTP/1.1 May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqR_ko40GAljnN5lz-sXd2WMhsClU_7QrHB7rf499sjyJ24Ebg5cVxEWEXbo-GDo-oibCqaq8kWC-TEj7cDNtQV0sUZl2a8PtacP1Lp5iC1u0D32G_KFoF6KqMbgtYjVWo89HshdgUsSqhQBpk-hCHBx8WFqEN4kOA47jRPL8ZkfSeA May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: 98c641670665465caa49f5d709911793 May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-DeleteServersTestJSON-636381056 May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:45:55.757665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:45:55.758998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98c641670665465caa49f5d709911793"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/98c641670665465caa49f5d709911793"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_98c641670665465caa49f5d709911793"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/98c641670665465caa49f5d709911793"}]}] May 10 17:45:55.758998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-DeleteServersTestJSON-636381056 May 10 17:45:55.758998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: 98c641670665465caa49f5d709911793 May 10 17:45:55.758998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-DeleteServersTestJSON-636381056 May 10 17:45:55.758998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-DeleteServersTestJSON-636381056-project May 10 17:45:55.758998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:45:55.758998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:45:55.758998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: ca6c3d8d36db4f5fbc6c24834f81f599 May 10 17:45:55.758998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-DeleteServersTestJSON-636381056-project May 10 17:45:55.758998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:45:55.758998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:55.758998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': 'acd7903d-232c-4666-939c-eb22c6fbf01b'} May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:45:55.759780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:45:55.760930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:45:55.760930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:45:55.760930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:45:55.760930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:45:55.760930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:45:55.760930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:45:55.760930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:45:55.760930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:55.760930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:45:55.760930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:45:55.760930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:45:55.760930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:45:55.760930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:45:55.760930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:45:55.760930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:45:55.760930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:45:55.760930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. May 10 17:45:55.760930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:45:55.762882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8a72144d-d870-4f0c-82f7-6442e111133a tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] Returning 404 to user: Instance acd7903d-232c-4666-939c-eb22c6fbf01b could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:45:55.763954 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8a72144d-d870-4f0c-82f7-6442e111133a tempest-DeleteServersTestJSON-636381056 tempest-DeleteServersTestJSON-636381056-project] 10.222.0.60 "GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b" status: 404 len: 111 microversion: 2.1 time: 0.059335 May 10 17:45:55.765499 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 125/242] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:55 2022] GET /compute/v2.1/servers/acd7903d-232c-4666-939c-eb22c6fbf01b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 17:45:56.175489 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3934ae45-2177-46d7-846b-ebe87827a989 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:56.176225 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3934ae45-2177-46d7-846b-ebe87827a989 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:56.199549 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3934ae45-2177-46d7-846b-ebe87827a989 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:56.201021 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3934ae45-2177-46d7-846b-ebe87827a989 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:56.203881 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3934ae45-2177-46d7-846b-ebe87827a989 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:56.205945 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3934ae45-2177-46d7-846b-ebe87827a989 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:56.657257 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3934ae45-2177-46d7-846b-ebe87827a989 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:56.673358 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3934ae45-2177-46d7-846b-ebe87827a989 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.502933 May 10 17:45:56.675595 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 118/243] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:56 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:57.696521 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-60d182a3-cb37-4751-88f3-2d930149588e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:57.697343 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-60d182a3-cb37-4751-88f3-2d930149588e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:57.708868 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-60d182a3-cb37-4751-88f3-2d930149588e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:57.709896 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-60d182a3-cb37-4751-88f3-2d930149588e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:57.710712 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-60d182a3-cb37-4751-88f3-2d930149588e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:57.711146 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-60d182a3-cb37-4751-88f3-2d930149588e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:57.990192 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-60d182a3-cb37-4751-88f3-2d930149588e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:58.007896 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-60d182a3-cb37-4751-88f3-2d930149588e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.313030 May 10 17:45:58.019888 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 126/244] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:57 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:45:59.028551 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5251f3ff-d07f-4ae5-ae59-c5debc7faf41 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:45:59.029408 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5251f3ff-d07f-4ae5-ae59-c5debc7faf41 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:45:59.035702 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5251f3ff-d07f-4ae5-ae59-c5debc7faf41 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:59.036590 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5251f3ff-d07f-4ae5-ae59-c5debc7faf41 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:59.038207 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5251f3ff-d07f-4ae5-ae59-c5debc7faf41 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:45:59.038908 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5251f3ff-d07f-4ae5-ae59-c5debc7faf41 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:45:59.290585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5251f3ff-d07f-4ae5-ae59-c5debc7faf41 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:45:59.306164 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5251f3ff-d07f-4ae5-ae59-c5debc7faf41 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.281960 May 10 17:45:59.306882 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 119/245] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:45:59 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:00.324989 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e2706d8b-c9cc-4b74-93cf-a5cdc2006df8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:00.326522 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e2706d8b-c9cc-4b74-93cf-a5cdc2006df8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:00.336993 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e2706d8b-c9cc-4b74-93cf-a5cdc2006df8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:00.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e2706d8b-c9cc-4b74-93cf-a5cdc2006df8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:00.338266 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e2706d8b-c9cc-4b74-93cf-a5cdc2006df8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:00.338712 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e2706d8b-c9cc-4b74-93cf-a5cdc2006df8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:00.623112 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e2706d8b-c9cc-4b74-93cf-a5cdc2006df8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:00.636611 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e2706d8b-c9cc-4b74-93cf-a5cdc2006df8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.316012 May 10 17:46:00.637472 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 127/246] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:00 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:01.674309 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ad9e3a30-6b58-47ad-b461-580c1a71c430 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:01.675160 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ad9e3a30-6b58-47ad-b461-580c1a71c430 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:01.688016 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ad9e3a30-6b58-47ad-b461-580c1a71c430 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:01.688632 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ad9e3a30-6b58-47ad-b461-580c1a71c430 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:01.689273 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ad9e3a30-6b58-47ad-b461-580c1a71c430 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:01.689716 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ad9e3a30-6b58-47ad-b461-580c1a71c430 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:01.914458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ad9e3a30-6b58-47ad-b461-580c1a71c430 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:01.924409 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ad9e3a30-6b58-47ad-b461-580c1a71c430 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.258107 May 10 17:46:01.925179 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 120/247] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:01 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:02.951120 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e844cef9-ee6a-488c-bd54-31190160fb59 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:02.951998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e844cef9-ee6a-488c-bd54-31190160fb59 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:02.961094 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e844cef9-ee6a-488c-bd54-31190160fb59 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:02.961654 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e844cef9-ee6a-488c-bd54-31190160fb59 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:02.963170 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e844cef9-ee6a-488c-bd54-31190160fb59 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:02.963719 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e844cef9-ee6a-488c-bd54-31190160fb59 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:03.202898 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e844cef9-ee6a-488c-bd54-31190160fb59 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:03.216383 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e844cef9-ee6a-488c-bd54-31190160fb59 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.270653 May 10 17:46:03.217840 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 128/248] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:02 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:03.581663 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b0ac05f5-f7b4-4fa2-bde2-f3bf848af0f7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-327084939", "imageRef": "a7737c62-8029-44aa-8da7-e46fea7607fb", "flavorRef": "452", "networks": [{"uuid": "e3f42295-b917-4bf6-8b9b-62165723f9ed"}]}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:46:03.663157 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-b0ac05f5-f7b4-4fa2-bde2-f3bf848af0f7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] validate_networks() for [('e3f42295-b917-4bf6-8b9b-62165723f9ed', None, None, None, None, None)] {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:46:04.249470 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-80d06fc4-4bc2-46e6-951e-c0834fdc5013 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:04.251176 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-80d06fc4-4bc2-46e6-951e-c0834fdc5013 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:04.262518 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-80d06fc4-4bc2-46e6-951e-c0834fdc5013 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:04.263435 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-80d06fc4-4bc2-46e6-951e-c0834fdc5013 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:04.265433 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-80d06fc4-4bc2-46e6-951e-c0834fdc5013 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:04.266282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-80d06fc4-4bc2-46e6-951e-c0834fdc5013 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:04.487820 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-b0ac05f5-f7b4-4fa2-bde2-f3bf848af0f7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:46:04.488297 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-b0ac05f5-f7b4-4fa2-bde2-f3bf848af0f7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:46:04.489204 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-b0ac05f5-f7b4-4fa2-bde2-f3bf848af0f7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:46:04.489723 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-b0ac05f5-f7b4-4fa2-bde2-f3bf848af0f7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:46:04.491201 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-b0ac05f5-f7b4-4fa2-bde2-f3bf848af0f7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:46:04.518647 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b0ac05f5-f7b4-4fa2-bde2-f3bf848af0f7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:04.519546 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b0ac05f5-f7b4-4fa2-bde2-f3bf848af0f7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:04.520751 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b0ac05f5-f7b4-4fa2-bde2-f3bf848af0f7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:04.524520 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b0ac05f5-f7b4-4fa2-bde2-f3bf848af0f7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:04.527296 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-80d06fc4-4bc2-46e6-951e-c0834fdc5013 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:04.536496 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-80d06fc4-4bc2-46e6-951e-c0834fdc5013 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.297127 May 10 17:46:04.537697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 129/249] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:04 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:04.556431 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-b0ac05f5-f7b4-4fa2-bde2-f3bf848af0f7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Getting quotas for project 563af4481d544b74bc5afba3f426e7e5. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:46:04.563445 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-b0ac05f5-f7b4-4fa2-bde2-f3bf848af0f7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Getting quotas for user f5a10f7c3b0a41ca8bd08cb83f850c38 and project 563af4481d544b74bc5afba3f426e7e5. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:46:04.582874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b0ac05f5-f7b4-4fa2-bde2-f3bf848af0f7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:46:04.586216 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b0ac05f5-f7b4-4fa2-bde2-f3bf848af0f7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7737c62-8029-44aa-8da7-e46fea7607fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:46:04.641095 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b0ac05f5-f7b4-4fa2-bde2-f3bf848af0f7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.063830 May 10 17:46:04.641992 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 121/250] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 17:46:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:46:04.657836 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4213237f-48b5-4d41-8bc9-7519951ad460 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:04.658461 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4213237f-48b5-4d41-8bc9-7519951ad460 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:04.747343 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4213237f-48b5-4d41-8bc9-7519951ad460 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:04.754860 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4213237f-48b5-4d41-8bc9-7519951ad460 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1213 microversion: 2.1 time: 0.103498 May 10 17:46:04.755467 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 130/251] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:04 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1213 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:05.553926 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2ac5c707-b4cf-4edc-b2bf-310473cca038 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:05.554716 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2ac5c707-b4cf-4edc-b2bf-310473cca038 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:05.561698 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2ac5c707-b4cf-4edc-b2bf-310473cca038 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:05.562157 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2ac5c707-b4cf-4edc-b2bf-310473cca038 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:05.562938 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2ac5c707-b4cf-4edc-b2bf-310473cca038 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:05.563399 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2ac5c707-b4cf-4edc-b2bf-310473cca038 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:05.718598 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2ac5c707-b4cf-4edc-b2bf-310473cca038 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:05.732992 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2ac5c707-b4cf-4edc-b2bf-310473cca038 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.181857 May 10 17:46:05.733611 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 122/252] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:05 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:05.780858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1af7587e-c3e0-4eb7-aee5-806f6d177ad5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:05.781838 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-1af7587e-c3e0-4eb7-aee5-806f6d177ad5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:05.790413 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1af7587e-c3e0-4eb7-aee5-806f6d177ad5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:05.790871 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1af7587e-c3e0-4eb7-aee5-806f6d177ad5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:05.791730 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1af7587e-c3e0-4eb7-aee5-806f6d177ad5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:05.792161 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1af7587e-c3e0-4eb7-aee5-806f6d177ad5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:05.882511 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1af7587e-c3e0-4eb7-aee5-806f6d177ad5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:05.894132 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-1af7587e-c3e0-4eb7-aee5-806f6d177ad5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1217 microversion: 2.1 time: 0.118897 May 10 17:46:05.894738 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 131/253] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:05 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:06.751270 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1f98fbb8-c9b6-4e64-8da1-92ff66ec3df4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:06.752029 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1f98fbb8-c9b6-4e64-8da1-92ff66ec3df4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:06.759111 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1f98fbb8-c9b6-4e64-8da1-92ff66ec3df4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:06.759601 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1f98fbb8-c9b6-4e64-8da1-92ff66ec3df4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:06.760382 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1f98fbb8-c9b6-4e64-8da1-92ff66ec3df4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:06.760822 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1f98fbb8-c9b6-4e64-8da1-92ff66ec3df4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:06.907688 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1f98fbb8-c9b6-4e64-8da1-92ff66ec3df4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:06.914105 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-49e39f69-3ca0-4fa0-b485-880e7e90e5d6 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:06.914724 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-49e39f69-3ca0-4fa0-b485-880e7e90e5d6 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:06.916664 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1f98fbb8-c9b6-4e64-8da1-92ff66ec3df4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.169670 May 10 17:46:06.917653 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 123/254] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:06 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:06.921145 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-49e39f69-3ca0-4fa0-b485-880e7e90e5d6 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:06.921594 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-49e39f69-3ca0-4fa0-b485-880e7e90e5d6 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:06.922407 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-49e39f69-3ca0-4fa0-b485-880e7e90e5d6 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:06.922849 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-49e39f69-3ca0-4fa0-b485-880e7e90e5d6 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:06.988701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-49e39f69-3ca0-4fa0-b485-880e7e90e5d6 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:06.996651 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-49e39f69-3ca0-4fa0-b485-880e7e90e5d6 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1217 microversion: 2.1 time: 0.087370 May 10 17:46:06.997239 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 132/255] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:06 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:07.934933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-38660384-408d-4b43-8aad-94161c839d7e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:07.935651 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-38660384-408d-4b43-8aad-94161c839d7e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:07.942671 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38660384-408d-4b43-8aad-94161c839d7e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:07.943122 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38660384-408d-4b43-8aad-94161c839d7e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:07.943937 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38660384-408d-4b43-8aad-94161c839d7e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:07.944373 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38660384-408d-4b43-8aad-94161c839d7e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:08.013835 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-45fa8872-8603-45fd-900e-0aedfa05df8d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:08.014465 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-45fa8872-8603-45fd-900e-0aedfa05df8d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:08.020875 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-45fa8872-8603-45fd-900e-0aedfa05df8d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:08.021332 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-45fa8872-8603-45fd-900e-0aedfa05df8d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:08.022158 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-45fa8872-8603-45fd-900e-0aedfa05df8d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:08.022655 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-45fa8872-8603-45fd-900e-0aedfa05df8d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:08.103579 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-45fa8872-8603-45fd-900e-0aedfa05df8d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:08.113848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-45fa8872-8603-45fd-900e-0aedfa05df8d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1265 microversion: 2.1 time: 0.104303 May 10 17:46:08.114711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 133/256] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:08 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1265 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:08.133213 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-38660384-408d-4b43-8aad-94161c839d7e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:08.140815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-38660384-408d-4b43-8aad-94161c839d7e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.210685 May 10 17:46:08.141392 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 124/257] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:07 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:09.132672 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-95b5e262-9b85-44e3-b32a-5c59db526e05 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:09.133438 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-95b5e262-9b85-44e3-b32a-5c59db526e05 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:09.140933 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-95b5e262-9b85-44e3-b32a-5c59db526e05 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:09.141472 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-95b5e262-9b85-44e3-b32a-5c59db526e05 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:09.142260 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-95b5e262-9b85-44e3-b32a-5c59db526e05 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:09.142989 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-95b5e262-9b85-44e3-b32a-5c59db526e05 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:09.159690 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-02cf00b5-28d9-49e0-ae16-c4539deca721 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:09.160954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-02cf00b5-28d9-49e0-ae16-c4539deca721 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:09.171486 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-02cf00b5-28d9-49e0-ae16-c4539deca721 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:09.171952 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-02cf00b5-28d9-49e0-ae16-c4539deca721 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:09.172744 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-02cf00b5-28d9-49e0-ae16-c4539deca721 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:09.173189 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-02cf00b5-28d9-49e0-ae16-c4539deca721 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:09.228029 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-95b5e262-9b85-44e3-b32a-5c59db526e05 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:09.240882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-95b5e262-9b85-44e3-b32a-5c59db526e05 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1271 microversion: 2.1 time: 0.112525 May 10 17:46:09.247405 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 134/258] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:09 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1271 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:09.430347 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-02cf00b5-28d9-49e0-ae16-c4539deca721 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:09.442948 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-02cf00b5-28d9-49e0-ae16-c4539deca721 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.286789 May 10 17:46:09.444263 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 125/259] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:09 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:09.627476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7fd8a950-8a00-47b8-a434-5e3cca7b2172 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-955745844", "imageRef": "a7737c62-8029-44aa-8da7-e46fea7607fb", "flavorRef": "452", "networks": [{"uuid": "29e73f79-8568-4d80-831b-136efa81b55a"}]}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:46:09.695027 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.network.neutron [None req-7fd8a950-8a00-47b8-a434-5e3cca7b2172 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] validate_networks() for [('29e73f79-8568-4d80-831b-136efa81b55a', None, None, None, None, None)] {{(pid=123753) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:46:10.258208 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-662626fd-7f75-4d3a-a643-479a958db389 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:10.258822 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-662626fd-7f75-4d3a-a643-479a958db389 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:10.265054 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-662626fd-7f75-4d3a-a643-479a958db389 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:10.265510 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-662626fd-7f75-4d3a-a643-479a958db389 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:10.266283 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-662626fd-7f75-4d3a-a643-479a958db389 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:10.266723 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-662626fd-7f75-4d3a-a643-479a958db389 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:10.447076 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-7fd8a950-8a00-47b8-a434-5e3cca7b2172 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Flavor limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:46:10.447639 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-7fd8a950-8a00-47b8-a434-5e3cca7b2172 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Image limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:46:10.448042 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-7fd8a950-8a00-47b8-a434-5e3cca7b2172 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Flavor pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:46:10.448415 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-7fd8a950-8a00-47b8-a434-5e3cca7b2172 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Image pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:46:10.448826 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-7fd8a950-8a00-47b8-a434-5e3cca7b2172 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:46:10.458816 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7fd8a950-8a00-47b8-a434-5e3cca7b2172 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:10.459266 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7fd8a950-8a00-47b8-a434-5e3cca7b2172 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:10.460166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7fd8a950-8a00-47b8-a434-5e3cca7b2172 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:10.460604 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7fd8a950-8a00-47b8-a434-5e3cca7b2172 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:10.480556 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-7fd8a950-8a00-47b8-a434-5e3cca7b2172 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Getting quotas for project 9a2c0807e3fc4161b894f123e8acc473. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:46:10.484608 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-7fd8a950-8a00-47b8-a434-5e3cca7b2172 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Getting quotas for user 37203169f06d42c59dc670dc416caf38 and project 9a2c0807e3fc4161b894f123e8acc473. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:46:10.496050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7fd8a950-8a00-47b8-a434-5e3cca7b2172 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Going to run 1 instances... {{(pid=123753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:46:10.498342 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7fd8a950-8a00-47b8-a434-5e3cca7b2172 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7737c62-8029-44aa-8da7-e46fea7607fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:46:10.520612 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-662626fd-7f75-4d3a-a643-479a958db389 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:10.530286 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-662626fd-7f75-4d3a-a643-479a958db389 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1313 microversion: 2.1 time: 0.275799 May 10 17:46:10.530872 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 126/260] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:10 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:10.535913 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-988595bd-1150-4a9c-852d-e53ccce8f203 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:10.536770 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-988595bd-1150-4a9c-852d-e53ccce8f203 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:10.543771 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-988595bd-1150-4a9c-852d-e53ccce8f203 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:10.544513 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-988595bd-1150-4a9c-852d-e53ccce8f203 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:10.545631 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-988595bd-1150-4a9c-852d-e53ccce8f203 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:10.546245 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-988595bd-1150-4a9c-852d-e53ccce8f203 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:10.552035 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7fd8a950-8a00-47b8-a434-5e3cca7b2172 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.929065 May 10 17:46:10.552701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 135/261] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 17:46:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:46:10.564164 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-15a7dd46-2b52-4e43-93dc-488a1478b191 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:10.565153 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-15a7dd46-2b52-4e43-93dc-488a1478b191 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:10.677818 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-15a7dd46-2b52-4e43-93dc-488a1478b191 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:10.689276 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-15a7dd46-2b52-4e43-93dc-488a1478b191 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1218 microversion: 2.1 time: 0.129350 May 10 17:46:10.690059 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 136/262] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:10 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1218 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:10.823789 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-988595bd-1150-4a9c-852d-e53ccce8f203 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:10.833833 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-988595bd-1150-4a9c-852d-e53ccce8f203 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.301686 May 10 17:46:10.844591 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 127/263] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:10 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:10.920272 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-f37a25c9-4513-4531-9537-4f34ea4dff96 req-143722ed-4df4-4417-96c1-70ecc9fdf7ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb", "tag": "4a82bcea-cd65-4970-a74d-ed9e14c9779d"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:46:10.938319 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-f37a25c9-4513-4531-9537-4f34ea4dff96 req-143722ed-4df4-4417-96c1-70ecc9fdf7ce service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:10.938734 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-f37a25c9-4513-4531-9537-4f34ea4dff96 req-143722ed-4df4-4417-96c1-70ecc9fdf7ce service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:10.953395 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-f37a25c9-4513-4531-9537-4f34ea4dff96 req-143722ed-4df4-4417-96c1-70ecc9fdf7ce service nova] Creating event network-changed:4a82bcea-cd65-4970-a74d-ed9e14c9779d for instance e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb on hv-cinder-84130 May 10 17:46:10.958997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-f37a25c9-4513-4531-9537-4f34ea4dff96 req-143722ed-4df4-4417-96c1-70ecc9fdf7ce service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045872 May 10 17:46:10.959773 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 137/264] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:46:11.547114 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8033551c-f6f4-4b6f-b57d-6ac677454a71 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:11.548560 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8033551c-f6f4-4b6f-b57d-6ac677454a71 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:11.554783 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8033551c-f6f4-4b6f-b57d-6ac677454a71 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:11.555229 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8033551c-f6f4-4b6f-b57d-6ac677454a71 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:11.556893 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8033551c-f6f4-4b6f-b57d-6ac677454a71 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:11.558103 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8033551c-f6f4-4b6f-b57d-6ac677454a71 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:11.709890 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8033551c-f6f4-4b6f-b57d-6ac677454a71 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:11.718026 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f1066010-8e83-4b8b-af8d-8b6360dca1f5 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:11.718730 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f1066010-8e83-4b8b-af8d-8b6360dca1f5 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:11.723222 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8033551c-f6f4-4b6f-b57d-6ac677454a71 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1313 microversion: 2.1 time: 0.179751 May 10 17:46:11.724111 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 128/265] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:11 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:11.736693 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f1066010-8e83-4b8b-af8d-8b6360dca1f5 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:11.737156 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f1066010-8e83-4b8b-af8d-8b6360dca1f5 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:11.738091 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f1066010-8e83-4b8b-af8d-8b6360dca1f5 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:11.738384 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f1066010-8e83-4b8b-af8d-8b6360dca1f5 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:11.808997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f1066010-8e83-4b8b-af8d-8b6360dca1f5 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:11.816553 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f1066010-8e83-4b8b-af8d-8b6360dca1f5 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1278 microversion: 2.1 time: 0.103259 May 10 17:46:11.817141 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 138/266] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:11 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1278 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:11.854715 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-517a8cd5-c91b-469e-b8e1-f324eab38f25 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:11.855415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-517a8cd5-c91b-469e-b8e1-f324eab38f25 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:11.861808 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-517a8cd5-c91b-469e-b8e1-f324eab38f25 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:11.862333 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-517a8cd5-c91b-469e-b8e1-f324eab38f25 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:11.863186 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-517a8cd5-c91b-469e-b8e1-f324eab38f25 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:11.863726 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-517a8cd5-c91b-469e-b8e1-f324eab38f25 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:12.037939 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-517a8cd5-c91b-469e-b8e1-f324eab38f25 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:12.046716 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-517a8cd5-c91b-469e-b8e1-f324eab38f25 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.196536 May 10 17:46:12.047299 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 129/267] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:11 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:12.742553 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-87c5e609-361c-471d-b518-42d612d51ee2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:12.743945 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-87c5e609-361c-471d-b518-42d612d51ee2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:12.754074 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-87c5e609-361c-471d-b518-42d612d51ee2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:12.757255 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-87c5e609-361c-471d-b518-42d612d51ee2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:12.761025 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-87c5e609-361c-471d-b518-42d612d51ee2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:12.762049 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-87c5e609-361c-471d-b518-42d612d51ee2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:12.835500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e7a7aff4-f84e-41ce-9412-c17cdff0c105 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:12.836895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e7a7aff4-f84e-41ce-9412-c17cdff0c105 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:12.848358 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7a7aff4-f84e-41ce-9412-c17cdff0c105 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:12.849990 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7a7aff4-f84e-41ce-9412-c17cdff0c105 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:12.851331 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7a7aff4-f84e-41ce-9412-c17cdff0c105 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:12.852115 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7a7aff4-f84e-41ce-9412-c17cdff0c105 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:12.949398 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e7a7aff4-f84e-41ce-9412-c17cdff0c105 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:12.957630 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e7a7aff4-f84e-41ce-9412-c17cdff0c105 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1278 microversion: 2.1 time: 0.127132 May 10 17:46:12.958838 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 130/268] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:12 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1278 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:13.035315 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-87c5e609-361c-471d-b518-42d612d51ee2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:13.044212 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-87c5e609-361c-471d-b518-42d612d51ee2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1313 microversion: 2.1 time: 0.305512 May 10 17:46:13.059099 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 139/269] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:12 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:13.065407 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d65e3c01-bf7d-43fc-9351-69069577d8ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:13.066035 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d65e3c01-bf7d-43fc-9351-69069577d8ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:13.080563 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d65e3c01-bf7d-43fc-9351-69069577d8ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:13.081032 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d65e3c01-bf7d-43fc-9351-69069577d8ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:13.081835 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d65e3c01-bf7d-43fc-9351-69069577d8ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:13.082280 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d65e3c01-bf7d-43fc-9351-69069577d8ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:13.460259 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d65e3c01-bf7d-43fc-9351-69069577d8ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:13.470628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d65e3c01-bf7d-43fc-9351-69069577d8ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.411759 May 10 17:46:13.472147 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 131/270] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:13 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:13.985576 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-88299991-1a89-4b48-adc3-daedab77c3c4 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:13.986215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-88299991-1a89-4b48-adc3-daedab77c3c4 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:13.992338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-88299991-1a89-4b48-adc3-daedab77c3c4 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:13.992825 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-88299991-1a89-4b48-adc3-daedab77c3c4 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:13.993612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-88299991-1a89-4b48-adc3-daedab77c3c4 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:13.994056 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-88299991-1a89-4b48-adc3-daedab77c3c4 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:14.060057 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-88299991-1a89-4b48-adc3-daedab77c3c4 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:14.065181 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a0aaa6e7-cb23-4306-b145-f5f104d8b139 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:14.066508 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a0aaa6e7-cb23-4306-b145-f5f104d8b139 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:14.068960 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-88299991-1a89-4b48-adc3-daedab77c3c4 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1278 microversion: 2.1 time: 0.088543 May 10 17:46:14.073028 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 140/271] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:13 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1278 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:14.074879 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0aaa6e7-cb23-4306-b145-f5f104d8b139 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:14.075473 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0aaa6e7-cb23-4306-b145-f5f104d8b139 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:14.076496 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0aaa6e7-cb23-4306-b145-f5f104d8b139 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:14.077900 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0aaa6e7-cb23-4306-b145-f5f104d8b139 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:14.239754 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a0aaa6e7-cb23-4306-b145-f5f104d8b139 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:14.248360 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a0aaa6e7-cb23-4306-b145-f5f104d8b139 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1313 microversion: 2.1 time: 0.186867 May 10 17:46:14.257543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 132/272] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:14 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:14.489544 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-14a888aa-a28a-4610-99f6-9b293b825137 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:14.491176 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-14a888aa-a28a-4610-99f6-9b293b825137 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:14.499409 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-14a888aa-a28a-4610-99f6-9b293b825137 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:14.500469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-14a888aa-a28a-4610-99f6-9b293b825137 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:14.501469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-14a888aa-a28a-4610-99f6-9b293b825137 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:14.502113 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-14a888aa-a28a-4610-99f6-9b293b825137 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:14.730176 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-14a888aa-a28a-4610-99f6-9b293b825137 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:14.739731 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-14a888aa-a28a-4610-99f6-9b293b825137 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.254529 May 10 17:46:14.740478 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 141/273] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:14 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:15.089416 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-fc25c87e-1cf4-4f7f-9953-d83ed53c9dcb tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:15.090069 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-fc25c87e-1cf4-4f7f-9953-d83ed53c9dcb tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:15.116425 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fc25c87e-1cf4-4f7f-9953-d83ed53c9dcb tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:15.119081 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fc25c87e-1cf4-4f7f-9953-d83ed53c9dcb tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:15.120769 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fc25c87e-1cf4-4f7f-9953-d83ed53c9dcb tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:15.126000 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fc25c87e-1cf4-4f7f-9953-d83ed53c9dcb tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:15.268216 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-49f2cf6d-9e1e-42e2-afc4-6d710541e3e5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:15.269182 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fc25c87e-1cf4-4f7f-9953-d83ed53c9dcb tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:15.269649 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-49f2cf6d-9e1e-42e2-afc4-6d710541e3e5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:15.282287 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-fc25c87e-1cf4-4f7f-9953-d83ed53c9dcb tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1276 microversion: 2.1 time: 0.197514 May 10 17:46:15.283884 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-49f2cf6d-9e1e-42e2-afc4-6d710541e3e5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:15.284554 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-49f2cf6d-9e1e-42e2-afc4-6d710541e3e5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:15.285570 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-49f2cf6d-9e1e-42e2-afc4-6d710541e3e5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:15.286233 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-49f2cf6d-9e1e-42e2-afc4-6d710541e3e5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:15.293808 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 133/274] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:15 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:15.438298 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-49f2cf6d-9e1e-42e2-afc4-6d710541e3e5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:15.448443 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-49f2cf6d-9e1e-42e2-afc4-6d710541e3e5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1313 microversion: 2.1 time: 0.187213 May 10 17:46:15.449111 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 142/275] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:15 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:15.757418 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-38216d27-bac8-49b3-bf93-1e778259bf02 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:15.758402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-38216d27-bac8-49b3-bf93-1e778259bf02 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:15.765453 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38216d27-bac8-49b3-bf93-1e778259bf02 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:15.765911 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38216d27-bac8-49b3-bf93-1e778259bf02 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:15.766714 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38216d27-bac8-49b3-bf93-1e778259bf02 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:15.767150 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38216d27-bac8-49b3-bf93-1e778259bf02 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:15.967612 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-38216d27-bac8-49b3-bf93-1e778259bf02 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:15.975941 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-38216d27-bac8-49b3-bf93-1e778259bf02 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.222733 May 10 17:46:15.977838 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 134/276] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:15 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:16.301062 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-18f6f462-a660-4757-ac2e-205c81347cbf tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:16.301674 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-18f6f462-a660-4757-ac2e-205c81347cbf tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:16.308965 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-18f6f462-a660-4757-ac2e-205c81347cbf tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:16.309615 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-18f6f462-a660-4757-ac2e-205c81347cbf tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:16.310647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-18f6f462-a660-4757-ac2e-205c81347cbf tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:16.311173 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-18f6f462-a660-4757-ac2e-205c81347cbf tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:16.427712 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-51e38d99-b0ae-4cef-a9d0-480501e75b1a req-cdbc2513-d1e8-4b10-a54e-e8e409999130 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "858afd1f-cdd5-4c30-b255-155c40b54fb0", "tag": "8eeae9a2-0065-4b4b-9a97-c00de1868cf2"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:46:16.449016 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-51e38d99-b0ae-4cef-a9d0-480501e75b1a req-cdbc2513-d1e8-4b10-a54e-e8e409999130 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:16.449674 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-51e38d99-b0ae-4cef-a9d0-480501e75b1a req-cdbc2513-d1e8-4b10-a54e-e8e409999130 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:16.463090 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-51e38d99-b0ae-4cef-a9d0-480501e75b1a req-cdbc2513-d1e8-4b10-a54e-e8e409999130 service nova] Creating event network-changed:8eeae9a2-0065-4b4b-9a97-c00de1868cf2 for instance 858afd1f-cdd5-4c30-b255-155c40b54fb0 on hv-cinder-84130 May 10 17:46:16.468659 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-51e38d99-b0ae-4cef-a9d0-480501e75b1a req-cdbc2513-d1e8-4b10-a54e-e8e409999130 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049020 May 10 17:46:16.469267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 135/277] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:46:16.475063 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-41c2992e-62d9-4b36-a653-acee4f8a82e2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:16.475795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-41c2992e-62d9-4b36-a653-acee4f8a82e2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:16.482127 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-41c2992e-62d9-4b36-a653-acee4f8a82e2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:16.482556 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-41c2992e-62d9-4b36-a653-acee4f8a82e2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:16.483342 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-41c2992e-62d9-4b36-a653-acee4f8a82e2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:16.483937 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-41c2992e-62d9-4b36-a653-acee4f8a82e2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:16.605790 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-18f6f462-a660-4757-ac2e-205c81347cbf tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:16.615154 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-18f6f462-a660-4757-ac2e-205c81347cbf tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.317945 May 10 17:46:16.620735 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 143/278] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:16 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:16.694265 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-41c2992e-62d9-4b36-a653-acee4f8a82e2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:16.707359 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-41c2992e-62d9-4b36-a653-acee4f8a82e2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1313 microversion: 2.1 time: 0.232564 May 10 17:46:16.707359 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 136/279] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:16 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:16.994762 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-cc0aee69-2b92-4291-8e44-36a4c0136387 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:16.995639 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-cc0aee69-2b92-4291-8e44-36a4c0136387 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:17.006734 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cc0aee69-2b92-4291-8e44-36a4c0136387 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:17.007600 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cc0aee69-2b92-4291-8e44-36a4c0136387 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:17.008475 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cc0aee69-2b92-4291-8e44-36a4c0136387 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:17.009171 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cc0aee69-2b92-4291-8e44-36a4c0136387 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:17.228423 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-cc0aee69-2b92-4291-8e44-36a4c0136387 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:17.236621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-cc0aee69-2b92-4291-8e44-36a4c0136387 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.246416 May 10 17:46:17.237850 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 144/280] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:16 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:17.298624 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-d3e5538b-8695-47ec-b058-e77a45d17adf req-185d1c63-bf75-48cb-a71c-7bb574bfeac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb", "name": "network-vif-plugged", "status": "completed", "tag": "4a82bcea-cd65-4970-a74d-ed9e14c9779d"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:46:17.319702 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-d3e5538b-8695-47ec-b058-e77a45d17adf req-185d1c63-bf75-48cb-a71c-7bb574bfeac6 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:17.320424 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-d3e5538b-8695-47ec-b058-e77a45d17adf req-185d1c63-bf75-48cb-a71c-7bb574bfeac6 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:17.356057 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-d3e5538b-8695-47ec-b058-e77a45d17adf req-185d1c63-bf75-48cb-a71c-7bb574bfeac6 service nova] Creating event network-vif-plugged:4a82bcea-cd65-4970-a74d-ed9e14c9779d for instance e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb on hv-cinder-84130 May 10 17:46:17.363091 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-d3e5538b-8695-47ec-b058-e77a45d17adf req-185d1c63-bf75-48cb-a71c-7bb574bfeac6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068153 May 10 17:46:17.364678 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 137/281] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:46:17.633803 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-d8d40607-8415-4b36-ae4c-7a9791bf4801 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:17.635194 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-d8d40607-8415-4b36-ae4c-7a9791bf4801 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:17.641811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d8d40607-8415-4b36-ae4c-7a9791bf4801 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:17.642290 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d8d40607-8415-4b36-ae4c-7a9791bf4801 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:17.643110 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d8d40607-8415-4b36-ae4c-7a9791bf4801 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:17.643702 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d8d40607-8415-4b36-ae4c-7a9791bf4801 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:17.723797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c5eec24b-33c5-4b2b-aca8-b856d1ffdf1b tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:17.725645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c5eec24b-33c5-4b2b-aca8-b856d1ffdf1b tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:17.732656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c5eec24b-33c5-4b2b-aca8-b856d1ffdf1b tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:17.733384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c5eec24b-33c5-4b2b-aca8-b856d1ffdf1b tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:17.734360 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c5eec24b-33c5-4b2b-aca8-b856d1ffdf1b tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:17.735508 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c5eec24b-33c5-4b2b-aca8-b856d1ffdf1b tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:17.789826 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-d8d40607-8415-4b36-ae4c-7a9791bf4801 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:17.799471 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-d8d40607-8415-4b36-ae4c-7a9791bf4801 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.170325 May 10 17:46:17.800671 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 145/282] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:17 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:17.887960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c5eec24b-33c5-4b2b-aca8-b856d1ffdf1b tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:17.895639 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c5eec24b-33c5-4b2b-aca8-b856d1ffdf1b tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1313 microversion: 2.1 time: 0.177035 May 10 17:46:17.896249 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 138/283] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:17 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:18.253838 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-665fae30-930e-4ba5-bb57-d75247b39baa tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:18.254443 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-665fae30-930e-4ba5-bb57-d75247b39baa tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:18.260580 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-665fae30-930e-4ba5-bb57-d75247b39baa tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:18.261029 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-665fae30-930e-4ba5-bb57-d75247b39baa tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:18.261794 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-665fae30-930e-4ba5-bb57-d75247b39baa tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:18.262223 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-665fae30-930e-4ba5-bb57-d75247b39baa tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:18.432205 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-665fae30-930e-4ba5-bb57-d75247b39baa tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:18.441492 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-665fae30-930e-4ba5-bb57-d75247b39baa tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.191312 May 10 17:46:18.442157 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 146/284] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:18 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:18.819263 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0673677a-ea52-4cd5-8fb4-b6f3ddc91c3f tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:18.820011 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0673677a-ea52-4cd5-8fb4-b6f3ddc91c3f tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:18.827754 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0673677a-ea52-4cd5-8fb4-b6f3ddc91c3f tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:18.828210 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0673677a-ea52-4cd5-8fb4-b6f3ddc91c3f tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:18.829207 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0673677a-ea52-4cd5-8fb4-b6f3ddc91c3f tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:18.829693 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0673677a-ea52-4cd5-8fb4-b6f3ddc91c3f tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:18.913315 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2fa4c164-db8e-48e0-b8ea-26cc8b0e7d65 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:18.914755 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-2fa4c164-db8e-48e0-b8ea-26cc8b0e7d65 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:18.923241 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2fa4c164-db8e-48e0-b8ea-26cc8b0e7d65 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:18.923241 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2fa4c164-db8e-48e0-b8ea-26cc8b0e7d65 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:18.923718 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2fa4c164-db8e-48e0-b8ea-26cc8b0e7d65 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:18.924132 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2fa4c164-db8e-48e0-b8ea-26cc8b0e7d65 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:19.020196 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0673677a-ea52-4cd5-8fb4-b6f3ddc91c3f tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:19.028924 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0673677a-ea52-4cd5-8fb4-b6f3ddc91c3f tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.213647 May 10 17:46:19.029678 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 139/285] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:18 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:19.092162 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-2fa4c164-db8e-48e0-b8ea-26cc8b0e7d65 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:19.101068 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-2fa4c164-db8e-48e0-b8ea-26cc8b0e7d65 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1313 microversion: 2.1 time: 0.192415 May 10 17:46:19.101662 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 147/286] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:18 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:19.462072 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ea858c38-1aee-4095-bb00-48e6c9201312 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:19.462818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ea858c38-1aee-4095-bb00-48e6c9201312 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:19.469545 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ea858c38-1aee-4095-bb00-48e6c9201312 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:19.470128 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ea858c38-1aee-4095-bb00-48e6c9201312 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:19.471100 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ea858c38-1aee-4095-bb00-48e6c9201312 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:19.471578 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ea858c38-1aee-4095-bb00-48e6c9201312 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:19.610592 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ea858c38-1aee-4095-bb00-48e6c9201312 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:19.618812 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ea858c38-1aee-4095-bb00-48e6c9201312 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.161143 May 10 17:46:19.619428 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 140/287] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:19 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:20.046263 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-0e053210-6b1c-4ada-bf8d-dffb49dbca2a tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:20.046863 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-0e053210-6b1c-4ada-bf8d-dffb49dbca2a tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:20.052983 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0e053210-6b1c-4ada-bf8d-dffb49dbca2a tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:20.053427 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0e053210-6b1c-4ada-bf8d-dffb49dbca2a tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:20.054190 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0e053210-6b1c-4ada-bf8d-dffb49dbca2a tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:20.054618 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0e053210-6b1c-4ada-bf8d-dffb49dbca2a tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:20.124806 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-78f12f87-dc96-4c19-98a9-5fe4ed3a5652 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:20.126010 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-78f12f87-dc96-4c19-98a9-5fe4ed3a5652 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:20.137954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-78f12f87-dc96-4c19-98a9-5fe4ed3a5652 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:20.138518 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-78f12f87-dc96-4c19-98a9-5fe4ed3a5652 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:20.139402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-78f12f87-dc96-4c19-98a9-5fe4ed3a5652 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:20.139904 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-78f12f87-dc96-4c19-98a9-5fe4ed3a5652 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:20.232823 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-0e053210-6b1c-4ada-bf8d-dffb49dbca2a tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:20.240352 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-0e053210-6b1c-4ada-bf8d-dffb49dbca2a tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.198229 May 10 17:46:20.240925 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 148/288] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:20 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:20.296090 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-78f12f87-dc96-4c19-98a9-5fe4ed3a5652 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:20.303334 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-78f12f87-dc96-4c19-98a9-5fe4ed3a5652 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1313 microversion: 2.1 time: 0.188646 May 10 17:46:20.303941 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 141/289] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:20 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:20.635253 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-018c2a0f-971e-4dff-8fa1-04369eb8edb1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:20.635885 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-018c2a0f-971e-4dff-8fa1-04369eb8edb1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:20.642458 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-018c2a0f-971e-4dff-8fa1-04369eb8edb1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:20.643042 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-018c2a0f-971e-4dff-8fa1-04369eb8edb1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:20.643980 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-018c2a0f-971e-4dff-8fa1-04369eb8edb1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:20.644417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-018c2a0f-971e-4dff-8fa1-04369eb8edb1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:20.784651 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-018c2a0f-971e-4dff-8fa1-04369eb8edb1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:20.792584 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-018c2a0f-971e-4dff-8fa1-04369eb8edb1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.161366 May 10 17:46:20.793145 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 149/290] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:20 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:21.258115 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-264113bf-2bc2-47eb-ad92-cd9324f8811b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:21.258717 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-264113bf-2bc2-47eb-ad92-cd9324f8811b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:21.266148 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-264113bf-2bc2-47eb-ad92-cd9324f8811b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:21.266595 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-264113bf-2bc2-47eb-ad92-cd9324f8811b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:21.267418 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-264113bf-2bc2-47eb-ad92-cd9324f8811b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:21.267862 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-264113bf-2bc2-47eb-ad92-cd9324f8811b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:21.321168 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-22ae9c4e-7324-4dba-8ddc-a5200affe585 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:21.322340 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-22ae9c4e-7324-4dba-8ddc-a5200affe585 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:21.332407 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-22ae9c4e-7324-4dba-8ddc-a5200affe585 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:21.333394 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-22ae9c4e-7324-4dba-8ddc-a5200affe585 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:21.334279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-22ae9c4e-7324-4dba-8ddc-a5200affe585 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:21.334730 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-22ae9c4e-7324-4dba-8ddc-a5200affe585 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:21.469420 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-264113bf-2bc2-47eb-ad92-cd9324f8811b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:21.477630 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-264113bf-2bc2-47eb-ad92-cd9324f8811b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.223068 May 10 17:46:21.479050 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 142/291] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:21 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:21.534695 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-22ae9c4e-7324-4dba-8ddc-a5200affe585 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:21.550480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-22ae9c4e-7324-4dba-8ddc-a5200affe585 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1313 microversion: 2.1 time: 0.233911 May 10 17:46:21.551393 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 150/292] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:21 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:21.811857 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2cf2c1ed-c3b4-41e4-93df-88eaa9a669fb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:21.812473 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2cf2c1ed-c3b4-41e4-93df-88eaa9a669fb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:21.819265 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2cf2c1ed-c3b4-41e4-93df-88eaa9a669fb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:21.819746 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2cf2c1ed-c3b4-41e4-93df-88eaa9a669fb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:21.820520 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2cf2c1ed-c3b4-41e4-93df-88eaa9a669fb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:21.821218 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2cf2c1ed-c3b4-41e4-93df-88eaa9a669fb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:21.952183 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2cf2c1ed-c3b4-41e4-93df-88eaa9a669fb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:21.959612 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2cf2c1ed-c3b4-41e4-93df-88eaa9a669fb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.153501 May 10 17:46:21.960185 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 143/293] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:21 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:22.496037 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f32f9991-0aac-4d0e-809e-add6eac5fa77 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:22.496889 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f32f9991-0aac-4d0e-809e-add6eac5fa77 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:22.503305 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f32f9991-0aac-4d0e-809e-add6eac5fa77 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:22.504117 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f32f9991-0aac-4d0e-809e-add6eac5fa77 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:22.505587 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f32f9991-0aac-4d0e-809e-add6eac5fa77 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:22.506193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f32f9991-0aac-4d0e-809e-add6eac5fa77 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:22.569078 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-339474ae-7dd5-4111-837d-5a493cde5c73 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:22.569928 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-339474ae-7dd5-4111-837d-5a493cde5c73 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:22.578114 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-339474ae-7dd5-4111-837d-5a493cde5c73 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:22.578564 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-339474ae-7dd5-4111-837d-5a493cde5c73 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:22.579447 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-339474ae-7dd5-4111-837d-5a493cde5c73 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:22.579815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-339474ae-7dd5-4111-837d-5a493cde5c73 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:22.733522 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f32f9991-0aac-4d0e-809e-add6eac5fa77 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:22.741558 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f32f9991-0aac-4d0e-809e-add6eac5fa77 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.249330 May 10 17:46:22.742445 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 151/294] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:22 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:22.768517 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-339474ae-7dd5-4111-837d-5a493cde5c73 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:22.777523 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-339474ae-7dd5-4111-837d-5a493cde5c73 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1313 microversion: 2.1 time: 0.213176 May 10 17:46:22.778509 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 144/295] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:22 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:22.978482 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f2e46808-66df-436c-bc10-21e17840343c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:22.979282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f2e46808-66df-436c-bc10-21e17840343c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:22.987506 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f2e46808-66df-436c-bc10-21e17840343c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:22.988199 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f2e46808-66df-436c-bc10-21e17840343c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:22.989414 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f2e46808-66df-436c-bc10-21e17840343c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:22.990113 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f2e46808-66df-436c-bc10-21e17840343c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:23.134239 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f2e46808-66df-436c-bc10-21e17840343c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:23.141647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f2e46808-66df-436c-bc10-21e17840343c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.169054 May 10 17:46:23.142212 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 152/296] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:22 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:23.760521 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-258ecb6d-28b9-4fee-9c67-cb60fded3e20 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:23.761121 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-258ecb6d-28b9-4fee-9c67-cb60fded3e20 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:23.767882 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-258ecb6d-28b9-4fee-9c67-cb60fded3e20 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:23.768328 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-258ecb6d-28b9-4fee-9c67-cb60fded3e20 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:23.769128 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-258ecb6d-28b9-4fee-9c67-cb60fded3e20 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:23.769569 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-258ecb6d-28b9-4fee-9c67-cb60fded3e20 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:23.795222 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ed19d05c-ab5e-4c60-bb96-c87c4984b1cc tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:23.795857 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ed19d05c-ab5e-4c60-bb96-c87c4984b1cc tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:23.801996 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ed19d05c-ab5e-4c60-bb96-c87c4984b1cc tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:23.802440 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ed19d05c-ab5e-4c60-bb96-c87c4984b1cc tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:23.803220 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ed19d05c-ab5e-4c60-bb96-c87c4984b1cc tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:23.803679 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ed19d05c-ab5e-4c60-bb96-c87c4984b1cc tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:23.990561 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-258ecb6d-28b9-4fee-9c67-cb60fded3e20 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:23.999007 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-258ecb6d-28b9-4fee-9c67-cb60fded3e20 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.243151 May 10 17:46:24.000157 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 145/297] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:23 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:24.020280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ed19d05c-ab5e-4c60-bb96-c87c4984b1cc tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:24.027740 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ed19d05c-ab5e-4c60-bb96-c87c4984b1cc tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1313 microversion: 2.1 time: 0.236636 May 10 17:46:24.028315 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 153/298] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:23 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:24.158101 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-64b92e1f-b9e1-4bb5-b7c6-63ccfc5f9eeb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:24.158735 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-64b92e1f-b9e1-4bb5-b7c6-63ccfc5f9eeb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:24.165215 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-64b92e1f-b9e1-4bb5-b7c6-63ccfc5f9eeb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:24.165906 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-64b92e1f-b9e1-4bb5-b7c6-63ccfc5f9eeb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:24.166683 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-64b92e1f-b9e1-4bb5-b7c6-63ccfc5f9eeb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:24.167123 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-64b92e1f-b9e1-4bb5-b7c6-63ccfc5f9eeb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:24.308606 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-64b92e1f-b9e1-4bb5-b7c6-63ccfc5f9eeb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:24.316944 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-64b92e1f-b9e1-4bb5-b7c6-63ccfc5f9eeb tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.162654 May 10 17:46:24.317540 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 146/299] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:24 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:25.016782 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-77b6d6e1-3f00-401d-8865-aca8cd0784dd tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:25.017437 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-77b6d6e1-3f00-401d-8865-aca8cd0784dd tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:25.023428 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-77b6d6e1-3f00-401d-8865-aca8cd0784dd tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:25.024437 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-77b6d6e1-3f00-401d-8865-aca8cd0784dd tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:25.025274 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-77b6d6e1-3f00-401d-8865-aca8cd0784dd tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:25.025773 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-77b6d6e1-3f00-401d-8865-aca8cd0784dd tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:25.044862 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2bf7bb01-e951-4f6a-aa98-8034a526f9ab tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:25.045697 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2bf7bb01-e951-4f6a-aa98-8034a526f9ab tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:25.052857 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2bf7bb01-e951-4f6a-aa98-8034a526f9ab tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:25.053424 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2bf7bb01-e951-4f6a-aa98-8034a526f9ab tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:25.054299 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2bf7bb01-e951-4f6a-aa98-8034a526f9ab tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:25.055036 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2bf7bb01-e951-4f6a-aa98-8034a526f9ab tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:25.271743 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-77b6d6e1-3f00-401d-8865-aca8cd0784dd tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:25.279208 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2bf7bb01-e951-4f6a-aa98-8034a526f9ab tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:25.290123 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-77b6d6e1-3f00-401d-8865-aca8cd0784dd tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.276688 May 10 17:46:25.290834 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 154/300] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:25 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:25.291779 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2bf7bb01-e951-4f6a-aa98-8034a526f9ab tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1313 microversion: 2.1 time: 0.250982 May 10 17:46:25.292886 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 147/301] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:25 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:25.334108 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c5594c03-b5ac-4b7d-973b-f2499d7e63b5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:25.334712 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c5594c03-b5ac-4b7d-973b-f2499d7e63b5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:25.340614 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c5594c03-b5ac-4b7d-973b-f2499d7e63b5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:25.341060 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c5594c03-b5ac-4b7d-973b-f2499d7e63b5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:25.341821 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c5594c03-b5ac-4b7d-973b-f2499d7e63b5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:25.342247 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c5594c03-b5ac-4b7d-973b-f2499d7e63b5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:25.489316 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c5594c03-b5ac-4b7d-973b-f2499d7e63b5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:25.498194 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c5594c03-b5ac-4b7d-973b-f2499d7e63b5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.168009 May 10 17:46:25.498774 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 155/302] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:25 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:26.308696 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-38553fad-612e-48e9-803e-f35cdedbfd5d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:26.309556 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-38553fad-612e-48e9-803e-f35cdedbfd5d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:26.309743 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-26921f75-701b-4196-bf73-3c6695daf3ce tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:26.310537 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-26921f75-701b-4196-bf73-3c6695daf3ce tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:26.319698 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38553fad-612e-48e9-803e-f35cdedbfd5d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:26.320625 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38553fad-612e-48e9-803e-f35cdedbfd5d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:26.321404 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-26921f75-701b-4196-bf73-3c6695daf3ce tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:26.322000 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-26921f75-701b-4196-bf73-3c6695daf3ce tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:26.322484 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38553fad-612e-48e9-803e-f35cdedbfd5d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:26.323287 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-26921f75-701b-4196-bf73-3c6695daf3ce tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:26.323661 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38553fad-612e-48e9-803e-f35cdedbfd5d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:26.324396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-26921f75-701b-4196-bf73-3c6695daf3ce tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:26.557221 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-26921f75-701b-4196-bf73-3c6695daf3ce tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:26.564632 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-26921f75-701b-4196-bf73-3c6695daf3ce tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1313 microversion: 2.1 time: 0.259914 May 10 17:46:26.565405 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 156/303] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:26 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:26.569227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-38553fad-612e-48e9-803e-f35cdedbfd5d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:26.575274 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-6185d1b9-935a-4202-bea0-35b657b28635 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:26.575926 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-6185d1b9-935a-4202-bea0-35b657b28635 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:26.578522 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-38553fad-612e-48e9-803e-f35cdedbfd5d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.274091 May 10 17:46:26.579114 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 148/304] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:26 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:26.582014 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6185d1b9-935a-4202-bea0-35b657b28635 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:26.582472 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6185d1b9-935a-4202-bea0-35b657b28635 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:26.583251 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6185d1b9-935a-4202-bea0-35b657b28635 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:26.583723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6185d1b9-935a-4202-bea0-35b657b28635 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:26.745884 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6185d1b9-935a-4202-bea0-35b657b28635 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:26.753667 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-6185d1b9-935a-4202-bea0-35b657b28635 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.187222 May 10 17:46:26.754253 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 157/305] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:26 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:27.582945 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-dfee7305-f35b-4ee7-ad2a-b67d0121c584 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:27.583705 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-dfee7305-f35b-4ee7-ad2a-b67d0121c584 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:27.590966 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dfee7305-f35b-4ee7-ad2a-b67d0121c584 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:27.591451 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dfee7305-f35b-4ee7-ad2a-b67d0121c584 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:27.592250 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dfee7305-f35b-4ee7-ad2a-b67d0121c584 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:27.592694 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dfee7305-f35b-4ee7-ad2a-b67d0121c584 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:27.596687 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8ea57719-01f3-4232-ab3c-c6d29afa7a22 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:27.597345 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8ea57719-01f3-4232-ab3c-c6d29afa7a22 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:27.604294 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8ea57719-01f3-4232-ab3c-c6d29afa7a22 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:27.604747 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8ea57719-01f3-4232-ab3c-c6d29afa7a22 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:27.605536 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8ea57719-01f3-4232-ab3c-c6d29afa7a22 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:27.605975 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8ea57719-01f3-4232-ab3c-c6d29afa7a22 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:27.797354 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-dfee7305-f35b-4ee7-ad2a-b67d0121c584 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:27.804854 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-dfee7305-f35b-4ee7-ad2a-b67d0121c584 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1313 microversion: 2.1 time: 0.226082 May 10 17:46:27.805532 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 149/306] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:27 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:27.813477 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-8ea57719-01f3-4232-ab3c-c6d29afa7a22 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:27.819161 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4d26554a-cd5e-4e5e-9aa3-96255545d213 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:27.819858 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4d26554a-cd5e-4e5e-9aa3-96255545d213 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:27.821835 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8ea57719-01f3-4232-ab3c-c6d29afa7a22 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.228466 May 10 17:46:27.822627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 158/307] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:27 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:27.833414 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4d26554a-cd5e-4e5e-9aa3-96255545d213 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:27.834087 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4d26554a-cd5e-4e5e-9aa3-96255545d213 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:27.835317 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4d26554a-cd5e-4e5e-9aa3-96255545d213 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:27.835891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4d26554a-cd5e-4e5e-9aa3-96255545d213 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:27.972906 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4d26554a-cd5e-4e5e-9aa3-96255545d213 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:27.981839 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4d26554a-cd5e-4e5e-9aa3-96255545d213 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.166789 May 10 17:46:27.982443 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 150/308] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:27 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:28.822213 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b7779b47-11a3-4f55-b5d0-99edbcd98730 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:28.822839 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-b7779b47-11a3-4f55-b5d0-99edbcd98730 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:28.829346 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b7779b47-11a3-4f55-b5d0-99edbcd98730 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:28.829878 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b7779b47-11a3-4f55-b5d0-99edbcd98730 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:28.830977 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b7779b47-11a3-4f55-b5d0-99edbcd98730 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:28.831508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b7779b47-11a3-4f55-b5d0-99edbcd98730 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:28.840432 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-42af1618-65dd-4ce4-af56-cff724059b6b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:28.841767 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-42af1618-65dd-4ce4-af56-cff724059b6b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:28.848890 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-42af1618-65dd-4ce4-af56-cff724059b6b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:28.849451 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-42af1618-65dd-4ce4-af56-cff724059b6b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:28.850350 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-42af1618-65dd-4ce4-af56-cff724059b6b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:28.850863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-42af1618-65dd-4ce4-af56-cff724059b6b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:29.080497 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b7779b47-11a3-4f55-b5d0-99edbcd98730 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:29.088827 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b7779b47-11a3-4f55-b5d0-99edbcd98730 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1497 microversion: 2.1 time: 0.270977 May 10 17:46:29.089419 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 159/309] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:28 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1497 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:29.094064 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f935cb53-aacf-4e00-b062-9dbe46649078 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:29.094677 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f935cb53-aacf-4e00-b062-9dbe46649078 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:29.100811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f935cb53-aacf-4e00-b062-9dbe46649078 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:29.101355 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f935cb53-aacf-4e00-b062-9dbe46649078 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:29.102725 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f935cb53-aacf-4e00-b062-9dbe46649078 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:29.103633 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f935cb53-aacf-4e00-b062-9dbe46649078 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:29.105391 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-42af1618-65dd-4ce4-af56-cff724059b6b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:29.113839 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-42af1618-65dd-4ce4-af56-cff724059b6b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.277735 May 10 17:46:29.114743 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 151/310] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:28 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:29.239338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f935cb53-aacf-4e00-b062-9dbe46649078 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:29.246866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f935cb53-aacf-4e00-b062-9dbe46649078 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1521 microversion: 2.1 time: 0.156476 May 10 17:46:29.247460 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 160/311] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:29 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:30.130135 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f9c905d2-2c65-459a-9328-68402964c856 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:30.130808 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f9c905d2-2c65-459a-9328-68402964c856 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:30.138548 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f9c905d2-2c65-459a-9328-68402964c856 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:30.139003 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f9c905d2-2c65-459a-9328-68402964c856 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:30.139827 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f9c905d2-2c65-459a-9328-68402964c856 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:30.140260 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f9c905d2-2c65-459a-9328-68402964c856 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:30.270827 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-505e8494-e796-48ca-b5a5-1c7e8bcec09d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:30.271672 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-505e8494-e796-48ca-b5a5-1c7e8bcec09d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:30.279064 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-505e8494-e796-48ca-b5a5-1c7e8bcec09d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:30.279728 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-505e8494-e796-48ca-b5a5-1c7e8bcec09d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:30.280647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-505e8494-e796-48ca-b5a5-1c7e8bcec09d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:30.281197 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-505e8494-e796-48ca-b5a5-1c7e8bcec09d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:30.290195 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f9c905d2-2c65-459a-9328-68402964c856 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:30.298857 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f9c905d2-2c65-459a-9328-68402964c856 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.172587 May 10 17:46:30.299647 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 152/312] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:30 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:30.418393 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-505e8494-e796-48ca-b5a5-1c7e8bcec09d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:30.427745 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-505e8494-e796-48ca-b5a5-1c7e8bcec09d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1501 microversion: 2.1 time: 0.160479 May 10 17:46:30.428552 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 161/313] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:30 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:30.447296 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1dcdc45b-20de-4d94-bd68-d91621db8fc0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:30.448462 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1dcdc45b-20de-4d94-bd68-d91621db8fc0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:30.454267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1dcdc45b-20de-4d94-bd68-d91621db8fc0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:30.455015 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1dcdc45b-20de-4d94-bd68-d91621db8fc0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:30.455859 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1dcdc45b-20de-4d94-bd68-d91621db8fc0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:30.456307 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1dcdc45b-20de-4d94-bd68-d91621db8fc0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:30.598581 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1dcdc45b-20de-4d94-bd68-d91621db8fc0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:30.606951 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1dcdc45b-20de-4d94-bd68-d91621db8fc0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1515 microversion: 2.1 time: 0.164154 May 10 17:46:30.607641 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 153/314] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:30 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:31.316385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c47a2adc-8959-4cfe-8350-b2b0a2944161 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:31.317001 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c47a2adc-8959-4cfe-8350-b2b0a2944161 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:31.324292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c47a2adc-8959-4cfe-8350-b2b0a2944161 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:31.324750 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c47a2adc-8959-4cfe-8350-b2b0a2944161 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:31.325545 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c47a2adc-8959-4cfe-8350-b2b0a2944161 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:31.325984 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c47a2adc-8959-4cfe-8350-b2b0a2944161 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:31.468483 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c47a2adc-8959-4cfe-8350-b2b0a2944161 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:31.476813 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c47a2adc-8959-4cfe-8350-b2b0a2944161 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.164166 May 10 17:46:31.477409 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 162/315] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:31 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:32.495558 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d7049dbe-733d-4ac7-b478-e1eb036db426 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:32.496167 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d7049dbe-733d-4ac7-b478-e1eb036db426 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:32.502584 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d7049dbe-733d-4ac7-b478-e1eb036db426 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:32.503038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d7049dbe-733d-4ac7-b478-e1eb036db426 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:32.503838 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d7049dbe-733d-4ac7-b478-e1eb036db426 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:32.504280 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d7049dbe-733d-4ac7-b478-e1eb036db426 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:32.634191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d7049dbe-733d-4ac7-b478-e1eb036db426 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:32.641496 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d7049dbe-733d-4ac7-b478-e1eb036db426 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.150036 May 10 17:46:32.642182 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 154/316] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:32 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:33.659444 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-324ce79d-fdb6-4682-a538-11af82735361 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:33.660045 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-324ce79d-fdb6-4682-a538-11af82735361 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:33.666564 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-324ce79d-fdb6-4682-a538-11af82735361 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:33.667011 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-324ce79d-fdb6-4682-a538-11af82735361 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:33.667801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-324ce79d-fdb6-4682-a538-11af82735361 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:33.668235 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-324ce79d-fdb6-4682-a538-11af82735361 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:33.795681 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-324ce79d-fdb6-4682-a538-11af82735361 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:33.802922 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-324ce79d-fdb6-4682-a538-11af82735361 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.147409 May 10 17:46:33.803498 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 163/317] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:33 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:34.820142 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4c1c8238-1c65-42b5-b2a5-4ec206500217 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:34.821175 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4c1c8238-1c65-42b5-b2a5-4ec206500217 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:34.827831 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4c1c8238-1c65-42b5-b2a5-4ec206500217 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:34.828383 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4c1c8238-1c65-42b5-b2a5-4ec206500217 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:34.829222 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4c1c8238-1c65-42b5-b2a5-4ec206500217 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:34.829772 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4c1c8238-1c65-42b5-b2a5-4ec206500217 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:34.970398 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4c1c8238-1c65-42b5-b2a5-4ec206500217 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:34.979201 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4c1c8238-1c65-42b5-b2a5-4ec206500217 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.162725 May 10 17:46:34.979910 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 155/318] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:34 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:35.127557 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8adcf74b-9564-41bd-a771-8784f99f1cc9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:35.128123 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8adcf74b-9564-41bd-a771-8784f99f1cc9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:35.134858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8adcf74b-9564-41bd-a771-8784f99f1cc9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:35.135311 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8adcf74b-9564-41bd-a771-8784f99f1cc9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:35.136353 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8adcf74b-9564-41bd-a771-8784f99f1cc9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:35.136796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8adcf74b-9564-41bd-a771-8784f99f1cc9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:35.165929 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8adcf74b-9564-41bd-a771-8784f99f1cc9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Going to try to terminate instance {{(pid=123753) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:46:35.250893 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8adcf74b-9564-41bd-a771-8784f99f1cc9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 204 len: 0 microversion: 2.1 time: 0.127053 May 10 17:46:35.251523 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 164/319] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:46:35 2022] DELETE /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:46:35.259874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ea7e72ab-6f52-4d31-9959-a7205f6de96b tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:35.260491 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ea7e72ab-6f52-4d31-9959-a7205f6de96b tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:35.267264 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ea7e72ab-6f52-4d31-9959-a7205f6de96b tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:35.267766 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ea7e72ab-6f52-4d31-9959-a7205f6de96b tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:35.268600 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ea7e72ab-6f52-4d31-9959-a7205f6de96b tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:35.269050 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ea7e72ab-6f52-4d31-9959-a7205f6de96b tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:35.404865 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ea7e72ab-6f52-4d31-9959-a7205f6de96b tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:35.412372 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ea7e72ab-6f52-4d31-9959-a7205f6de96b tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1503 microversion: 2.1 time: 0.156590 May 10 17:46:35.413134 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 156/320] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:35 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:36.000324 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-08071a19-4cbd-4eb1-a5e7-be4b3177f60d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:36.001037 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-08071a19-4cbd-4eb1-a5e7-be4b3177f60d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:36.007597 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-08071a19-4cbd-4eb1-a5e7-be4b3177f60d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:36.008689 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-08071a19-4cbd-4eb1-a5e7-be4b3177f60d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:36.009707 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-08071a19-4cbd-4eb1-a5e7-be4b3177f60d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:36.010146 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-08071a19-4cbd-4eb1-a5e7-be4b3177f60d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:36.146421 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-08071a19-4cbd-4eb1-a5e7-be4b3177f60d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:36.153869 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-08071a19-4cbd-4eb1-a5e7-be4b3177f60d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.159880 May 10 17:46:36.154423 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 165/321] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:35 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:36.429231 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cd74b48b-b0e6-4717-b8c2-0def8fcb5935 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:36.430921 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cd74b48b-b0e6-4717-b8c2-0def8fcb5935 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:36.437320 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd74b48b-b0e6-4717-b8c2-0def8fcb5935 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:36.437776 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd74b48b-b0e6-4717-b8c2-0def8fcb5935 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:36.438541 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd74b48b-b0e6-4717-b8c2-0def8fcb5935 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:36.438982 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cd74b48b-b0e6-4717-b8c2-0def8fcb5935 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:36.566590 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cd74b48b-b0e6-4717-b8c2-0def8fcb5935 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:36.576552 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cd74b48b-b0e6-4717-b8c2-0def8fcb5935 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1503 microversion: 2.1 time: 0.151084 May 10 17:46:36.577140 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 157/322] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:36 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:37.170119 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a0765ce1-4ad1-48d6-b539-d691b609d574 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:37.170725 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a0765ce1-4ad1-48d6-b539-d691b609d574 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:37.176617 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a0765ce1-4ad1-48d6-b539-d691b609d574 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:37.177060 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a0765ce1-4ad1-48d6-b539-d691b609d574 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:37.177812 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a0765ce1-4ad1-48d6-b539-d691b609d574 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:37.178243 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a0765ce1-4ad1-48d6-b539-d691b609d574 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:37.308978 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a0765ce1-4ad1-48d6-b539-d691b609d574 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:37.316290 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a0765ce1-4ad1-48d6-b539-d691b609d574 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.149997 May 10 17:46:37.316867 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 166/323] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:37 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:37.594034 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f07df9cd-0f45-4703-bf37-de11829bfbe9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:37.594644 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f07df9cd-0f45-4703-bf37-de11829bfbe9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:37.601017 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f07df9cd-0f45-4703-bf37-de11829bfbe9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:37.601492 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f07df9cd-0f45-4703-bf37-de11829bfbe9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:37.602846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f07df9cd-0f45-4703-bf37-de11829bfbe9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:37.603294 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f07df9cd-0f45-4703-bf37-de11829bfbe9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:37.730920 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f07df9cd-0f45-4703-bf37-de11829bfbe9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:37.738304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f07df9cd-0f45-4703-bf37-de11829bfbe9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1503 microversion: 2.1 time: 0.148155 May 10 17:46:37.738872 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 158/324] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:37 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:38.333996 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-6177c619-7565-415f-8409-2e60dee4641c tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:38.334609 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-6177c619-7565-415f-8409-2e60dee4641c tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:38.341102 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6177c619-7565-415f-8409-2e60dee4641c tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:38.341564 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6177c619-7565-415f-8409-2e60dee4641c tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:38.342343 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6177c619-7565-415f-8409-2e60dee4641c tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:38.342785 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6177c619-7565-415f-8409-2e60dee4641c tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:38.473242 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6177c619-7565-415f-8409-2e60dee4641c tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:38.480825 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-6177c619-7565-415f-8409-2e60dee4641c tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.150662 May 10 17:46:38.481515 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 167/325] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:38 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:38.755801 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-04a79f5f-e49f-4501-b318-d49fdc84317f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:38.756486 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-04a79f5f-e49f-4501-b318-d49fdc84317f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:38.763558 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-04a79f5f-e49f-4501-b318-d49fdc84317f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:38.764001 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-04a79f5f-e49f-4501-b318-d49fdc84317f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:38.764765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-04a79f5f-e49f-4501-b318-d49fdc84317f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:38.765201 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-04a79f5f-e49f-4501-b318-d49fdc84317f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:38.893162 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-04a79f5f-e49f-4501-b318-d49fdc84317f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:38.901327 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-04a79f5f-e49f-4501-b318-d49fdc84317f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1503 microversion: 2.1 time: 0.149361 May 10 17:46:38.901911 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 159/326] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:38 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:39.498415 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-41fdb2f8-6f3f-40e7-83ee-24b2874f7811 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:39.499019 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-41fdb2f8-6f3f-40e7-83ee-24b2874f7811 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:39.505017 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-41fdb2f8-6f3f-40e7-83ee-24b2874f7811 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:39.505464 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-41fdb2f8-6f3f-40e7-83ee-24b2874f7811 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:39.506222 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-41fdb2f8-6f3f-40e7-83ee-24b2874f7811 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:39.506657 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-41fdb2f8-6f3f-40e7-83ee-24b2874f7811 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:39.635450 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-41fdb2f8-6f3f-40e7-83ee-24b2874f7811 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:39.642741 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-41fdb2f8-6f3f-40e7-83ee-24b2874f7811 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.148163 May 10 17:46:39.643308 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 168/327] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:39 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:39.918006 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-377d6da2-0cfa-4615-8742-402b5853c2dc tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:39.918612 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-377d6da2-0cfa-4615-8742-402b5853c2dc tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:39.924938 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-377d6da2-0cfa-4615-8742-402b5853c2dc tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:39.925392 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-377d6da2-0cfa-4615-8742-402b5853c2dc tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:39.926155 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-377d6da2-0cfa-4615-8742-402b5853c2dc tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:39.927091 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-377d6da2-0cfa-4615-8742-402b5853c2dc tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:40.060523 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-377d6da2-0cfa-4615-8742-402b5853c2dc tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:40.068252 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-377d6da2-0cfa-4615-8742-402b5853c2dc tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1503 microversion: 2.1 time: 0.154080 May 10 17:46:40.068828 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 160/328] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:39 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:40.660024 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-cdd9a9c3-c15a-4f01-b60e-a5ae4a339f04 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:40.660638 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-cdd9a9c3-c15a-4f01-b60e-a5ae4a339f04 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:40.667215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cdd9a9c3-c15a-4f01-b60e-a5ae4a339f04 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:40.667694 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cdd9a9c3-c15a-4f01-b60e-a5ae4a339f04 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:40.668459 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cdd9a9c3-c15a-4f01-b60e-a5ae4a339f04 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:40.668897 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cdd9a9c3-c15a-4f01-b60e-a5ae4a339f04 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:40.796663 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-cdd9a9c3-c15a-4f01-b60e-a5ae4a339f04 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:40.803870 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-cdd9a9c3-c15a-4f01-b60e-a5ae4a339f04 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.147753 May 10 17:46:40.804438 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 169/329] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:40 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:41.086833 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-09c851cb-159c-4233-a91b-f430c8a94bd1 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:41.087569 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-09c851cb-159c-4233-a91b-f430c8a94bd1 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:41.093874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-09c851cb-159c-4233-a91b-f430c8a94bd1 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:41.094326 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-09c851cb-159c-4233-a91b-f430c8a94bd1 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:41.095104 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-09c851cb-159c-4233-a91b-f430c8a94bd1 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:41.095568 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-09c851cb-159c-4233-a91b-f430c8a94bd1 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:41.234369 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-09c851cb-159c-4233-a91b-f430c8a94bd1 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:41.243637 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-09c851cb-159c-4233-a91b-f430c8a94bd1 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1503 microversion: 2.1 time: 0.161115 May 10 17:46:41.244410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 161/330] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:41 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:41.510399 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-cfe3bd73-dd11-4fd4-9001-4a4a5e5c202f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:46:41.511483 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-cfe3bd73-dd11-4fd4-9001-4a4a5e5c202f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:41.519600 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cfe3bd73-dd11-4fd4-9001-4a4a5e5c202f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:41.520058 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cfe3bd73-dd11-4fd4-9001-4a4a5e5c202f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:41.520871 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cfe3bd73-dd11-4fd4-9001-4a4a5e5c202f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:41.521311 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cfe3bd73-dd11-4fd4-9001-4a4a5e5c202f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:41.545318 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.objects.instance [None req-cfe3bd73-dd11-4fd4-9001-4a4a5e5c202f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lazy-loading 'flavor' on Instance uuid c1bf8bc9-b3de-4555-8835-15dd3a89bc56 {{(pid=123753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:46:41.618046 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-cfe3bd73-dd11-4fd4-9001-4a4a5e5c202f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "POST /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56/action" status: 200 len: 32 microversion: 2.1 time: 0.112074 May 10 17:46:41.618595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 170/331] 10.222.0.60 () {60 vars in 1277 bytes} [Tue May 10 17:46:41 2022] POST /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56/action => generated 32 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:46:41.627580 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d5293ca2-ced0-493a-8c52-c36a81c31a65 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:41.628195 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d5293ca2-ced0-493a-8c52-c36a81c31a65 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:41.634823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d5293ca2-ced0-493a-8c52-c36a81c31a65 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:41.635272 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d5293ca2-ced0-493a-8c52-c36a81c31a65 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:41.636072 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d5293ca2-ced0-493a-8c52-c36a81c31a65 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:41.636519 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d5293ca2-ced0-493a-8c52-c36a81c31a65 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:41.766132 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d5293ca2-ced0-493a-8c52-c36a81c31a65 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:41.774443 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d5293ca2-ced0-493a-8c52-c36a81c31a65 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.150767 May 10 17:46:41.775012 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 162/332] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:41 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:41.823061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9c0c37d5-d626-40a9-94b4-e05495d4ce86 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:41.823793 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-9c0c37d5-d626-40a9-94b4-e05495d4ce86 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:41.829901 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9c0c37d5-d626-40a9-94b4-e05495d4ce86 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:41.830348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9c0c37d5-d626-40a9-94b4-e05495d4ce86 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:41.831100 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9c0c37d5-d626-40a9-94b4-e05495d4ce86 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:41.831584 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9c0c37d5-d626-40a9-94b4-e05495d4ce86 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:41.961942 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-9c0c37d5-d626-40a9-94b4-e05495d4ce86 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:41.969410 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-9c0c37d5-d626-40a9-94b4-e05495d4ce86 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.151420 May 10 17:46:41.969973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 171/333] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:41 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:42.260649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5f952a80-19e4-4c3a-b6eb-556a57a0d83d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:42.261543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5f952a80-19e4-4c3a-b6eb-556a57a0d83d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:42.267980 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5f952a80-19e4-4c3a-b6eb-556a57a0d83d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:42.268427 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5f952a80-19e4-4c3a-b6eb-556a57a0d83d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:42.269199 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5f952a80-19e4-4c3a-b6eb-556a57a0d83d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:42.269634 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5f952a80-19e4-4c3a-b6eb-556a57a0d83d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:42.411635 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5f952a80-19e4-4c3a-b6eb-556a57a0d83d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:42.428282 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5f952a80-19e4-4c3a-b6eb-556a57a0d83d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1503 microversion: 2.1 time: 0.171483 May 10 17:46:42.428874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 163/334] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:42 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:42.795426 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1c2d68ef-a822-4975-ad7c-cdd01856ba89 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:42.796327 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-1c2d68ef-a822-4975-ad7c-cdd01856ba89 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:42.803389 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1c2d68ef-a822-4975-ad7c-cdd01856ba89 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:42.803884 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1c2d68ef-a822-4975-ad7c-cdd01856ba89 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:42.806530 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1c2d68ef-a822-4975-ad7c-cdd01856ba89 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:42.806998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1c2d68ef-a822-4975-ad7c-cdd01856ba89 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:42.964519 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1c2d68ef-a822-4975-ad7c-cdd01856ba89 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:42.972235 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-1c2d68ef-a822-4975-ad7c-cdd01856ba89 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.183154 May 10 17:46:42.973070 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 172/335] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:42 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:42.985914 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f7615c93-8bb1-496e-8e6d-8d07a401782b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:42.986525 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f7615c93-8bb1-496e-8e6d-8d07a401782b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:42.993250 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f7615c93-8bb1-496e-8e6d-8d07a401782b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:42.993620 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f7615c93-8bb1-496e-8e6d-8d07a401782b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:42.994395 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f7615c93-8bb1-496e-8e6d-8d07a401782b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:42.994834 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f7615c93-8bb1-496e-8e6d-8d07a401782b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:43.129132 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f7615c93-8bb1-496e-8e6d-8d07a401782b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:43.137424 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f7615c93-8bb1-496e-8e6d-8d07a401782b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.155261 May 10 17:46:43.138003 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 164/336] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:42 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:43.446465 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b30d9faa-6de6-4a61-b7a6-a0801094350d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:43.447075 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-b30d9faa-6de6-4a61-b7a6-a0801094350d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:43.453632 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b30d9faa-6de6-4a61-b7a6-a0801094350d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:43.454091 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b30d9faa-6de6-4a61-b7a6-a0801094350d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:43.454887 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b30d9faa-6de6-4a61-b7a6-a0801094350d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:43.455336 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b30d9faa-6de6-4a61-b7a6-a0801094350d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:43.602719 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b30d9faa-6de6-4a61-b7a6-a0801094350d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:43.610666 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b30d9faa-6de6-4a61-b7a6-a0801094350d tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1503 microversion: 2.1 time: 0.168460 May 10 17:46:43.611264 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 173/337] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:43 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:43.990148 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a0a3cb2e-71e7-421c-9d53-bfee19c48106 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:43.990787 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a0a3cb2e-71e7-421c-9d53-bfee19c48106 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:43.998322 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0a3cb2e-71e7-421c-9d53-bfee19c48106 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:43.998778 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0a3cb2e-71e7-421c-9d53-bfee19c48106 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:43.999598 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0a3cb2e-71e7-421c-9d53-bfee19c48106 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:44.000041 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0a3cb2e-71e7-421c-9d53-bfee19c48106 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:44.130796 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a0a3cb2e-71e7-421c-9d53-bfee19c48106 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:44.138335 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a0a3cb2e-71e7-421c-9d53-bfee19c48106 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.152116 May 10 17:46:44.139014 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 165/338] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:43 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:44.154475 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b79214b2-f804-4d4a-83c7-cafacbf6fecd tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:44.155144 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-b79214b2-f804-4d4a-83c7-cafacbf6fecd tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:44.161047 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b79214b2-f804-4d4a-83c7-cafacbf6fecd tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:44.161471 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b79214b2-f804-4d4a-83c7-cafacbf6fecd tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:44.162251 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b79214b2-f804-4d4a-83c7-cafacbf6fecd tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:44.163034 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b79214b2-f804-4d4a-83c7-cafacbf6fecd tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:44.300102 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b79214b2-f804-4d4a-83c7-cafacbf6fecd tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:44.307731 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b79214b2-f804-4d4a-83c7-cafacbf6fecd tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.157040 May 10 17:46:44.308308 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 174/339] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:44 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:44.628364 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d503b349-0984-4506-96fa-98c409edd3b3 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:44.628972 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d503b349-0984-4506-96fa-98c409edd3b3 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:44.635401 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d503b349-0984-4506-96fa-98c409edd3b3 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:44.635867 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d503b349-0984-4506-96fa-98c409edd3b3 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:44.636641 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d503b349-0984-4506-96fa-98c409edd3b3 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:44.637085 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d503b349-0984-4506-96fa-98c409edd3b3 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:44.766526 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d503b349-0984-4506-96fa-98c409edd3b3 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:44.774922 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d503b349-0984-4506-96fa-98c409edd3b3 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1503 microversion: 2.1 time: 0.150249 May 10 17:46:44.775522 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 166/340] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:44 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:45.155019 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-372f28e8-15bc-41a3-95db-04cdbf1c4f95 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:45.155628 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-372f28e8-15bc-41a3-95db-04cdbf1c4f95 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:45.161574 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-372f28e8-15bc-41a3-95db-04cdbf1c4f95 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:45.162022 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-372f28e8-15bc-41a3-95db-04cdbf1c4f95 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:45.162773 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-372f28e8-15bc-41a3-95db-04cdbf1c4f95 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:45.163206 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-372f28e8-15bc-41a3-95db-04cdbf1c4f95 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:45.295024 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-372f28e8-15bc-41a3-95db-04cdbf1c4f95 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:45.302499 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-372f28e8-15bc-41a3-95db-04cdbf1c4f95 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.151399 May 10 17:46:45.303071 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 175/341] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:45 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:45.325116 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ef6d08b6-0f46-4ec3-b7b0-f41cd320958e tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:45.325915 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ef6d08b6-0f46-4ec3-b7b0-f41cd320958e tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:45.332762 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef6d08b6-0f46-4ec3-b7b0-f41cd320958e tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:45.333212 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef6d08b6-0f46-4ec3-b7b0-f41cd320958e tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:45.333987 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef6d08b6-0f46-4ec3-b7b0-f41cd320958e tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:45.334458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef6d08b6-0f46-4ec3-b7b0-f41cd320958e tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:45.463396 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ef6d08b6-0f46-4ec3-b7b0-f41cd320958e tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:45.470644 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ef6d08b6-0f46-4ec3-b7b0-f41cd320958e tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.149707 May 10 17:46:45.471203 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 167/342] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:45 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:45.792633 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-d91463ab-4982-48da-bcf6-9a80099e29db tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:45.793181 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-d91463ab-4982-48da-bcf6-9a80099e29db tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:45.799147 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d91463ab-4982-48da-bcf6-9a80099e29db tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:45.799653 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d91463ab-4982-48da-bcf6-9a80099e29db tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:45.800420 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d91463ab-4982-48da-bcf6-9a80099e29db tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:45.800853 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d91463ab-4982-48da-bcf6-9a80099e29db tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:45.930980 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-d91463ab-4982-48da-bcf6-9a80099e29db tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:45.938297 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-d91463ab-4982-48da-bcf6-9a80099e29db tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1503 microversion: 2.1 time: 0.150498 May 10 17:46:45.938866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 176/343] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:45 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:46.320724 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4be4ffce-17e8-4e11-b9de-65c94e5a33ce tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:46.321593 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4be4ffce-17e8-4e11-b9de-65c94e5a33ce tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:46.328142 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4be4ffce-17e8-4e11-b9de-65c94e5a33ce tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:46.328899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4be4ffce-17e8-4e11-b9de-65c94e5a33ce tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:46.332595 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4be4ffce-17e8-4e11-b9de-65c94e5a33ce tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:46.332595 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4be4ffce-17e8-4e11-b9de-65c94e5a33ce tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:46.474543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4be4ffce-17e8-4e11-b9de-65c94e5a33ce tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:46.482846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4be4ffce-17e8-4e11-b9de-65c94e5a33ce tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.166571 May 10 17:46:46.488535 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5cf3822b-f471-460e-a137-3bccdf6830b9 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:46.489408 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5cf3822b-f471-460e-a137-3bccdf6830b9 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:46.492560 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 168/344] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:46 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:46.497433 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5cf3822b-f471-460e-a137-3bccdf6830b9 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:46.498085 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5cf3822b-f471-460e-a137-3bccdf6830b9 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:46.498960 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5cf3822b-f471-460e-a137-3bccdf6830b9 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:46.499511 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5cf3822b-f471-460e-a137-3bccdf6830b9 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:46.641394 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-5cf3822b-f471-460e-a137-3bccdf6830b9 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:46.651310 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-5cf3822b-f471-460e-a137-3bccdf6830b9 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.166917 May 10 17:46:46.651923 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 177/345] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:46 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:46.955579 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2f64d180-e40b-4ccf-877b-a513db436472 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:46.956193 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2f64d180-e40b-4ccf-877b-a513db436472 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:46.962574 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2f64d180-e40b-4ccf-877b-a513db436472 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:46.963031 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2f64d180-e40b-4ccf-877b-a513db436472 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:46.963841 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2f64d180-e40b-4ccf-877b-a513db436472 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:46.964286 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2f64d180-e40b-4ccf-877b-a513db436472 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:47.306923 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2f64d180-e40b-4ccf-877b-a513db436472 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:47.314836 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2f64d180-e40b-4ccf-877b-a513db436472 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1503 microversion: 2.1 time: 0.363106 May 10 17:46:47.315417 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 169/346] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:46 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1503 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:47.501378 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ab2cfa78-2e1d-4133-bd74-531ae681119a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:47.502146 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ab2cfa78-2e1d-4133-bd74-531ae681119a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:47.509916 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ab2cfa78-2e1d-4133-bd74-531ae681119a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:47.510418 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ab2cfa78-2e1d-4133-bd74-531ae681119a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:47.511626 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ab2cfa78-2e1d-4133-bd74-531ae681119a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:47.512188 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ab2cfa78-2e1d-4133-bd74-531ae681119a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:47.671131 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-fbae6a78-adbc-44f1-b2a6-7e58239fbda4 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:47.672294 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-fbae6a78-adbc-44f1-b2a6-7e58239fbda4 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:47.676323 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ab2cfa78-2e1d-4133-bd74-531ae681119a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:47.682777 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fbae6a78-adbc-44f1-b2a6-7e58239fbda4 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:47.683237 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fbae6a78-adbc-44f1-b2a6-7e58239fbda4 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:47.684285 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fbae6a78-adbc-44f1-b2a6-7e58239fbda4 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:47.686269 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fbae6a78-adbc-44f1-b2a6-7e58239fbda4 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:47.687841 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ab2cfa78-2e1d-4133-bd74-531ae681119a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.190874 May 10 17:46:47.701079 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 178/347] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:47 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:47.853913 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fbae6a78-adbc-44f1-b2a6-7e58239fbda4 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:47.862890 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-fbae6a78-adbc-44f1-b2a6-7e58239fbda4 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.197056 May 10 17:46:47.863487 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 170/348] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:47 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:48.331664 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-3004647d-67e7-4d77-b2bd-117e277fb21f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:48.332279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-3004647d-67e7-4d77-b2bd-117e277fb21f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:48.338732 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3004647d-67e7-4d77-b2bd-117e277fb21f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:48.339184 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3004647d-67e7-4d77-b2bd-117e277fb21f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:48.340012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3004647d-67e7-4d77-b2bd-117e277fb21f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:48.340452 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3004647d-67e7-4d77-b2bd-117e277fb21f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:48.473998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-3004647d-67e7-4d77-b2bd-117e277fb21f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:48.482135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-3004647d-67e7-4d77-b2bd-117e277fb21f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1503 microversion: 2.1 time: 0.154220 May 10 17:46:48.482710 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 179/349] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:48 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:48.718235 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c56e4e32-37dd-45b4-95f4-4e9bd634ac97 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:48.718872 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c56e4e32-37dd-45b4-95f4-4e9bd634ac97 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:48.725266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c56e4e32-37dd-45b4-95f4-4e9bd634ac97 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:48.725721 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c56e4e32-37dd-45b4-95f4-4e9bd634ac97 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:48.727711 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c56e4e32-37dd-45b4-95f4-4e9bd634ac97 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:48.728165 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c56e4e32-37dd-45b4-95f4-4e9bd634ac97 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:48.859541 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c56e4e32-37dd-45b4-95f4-4e9bd634ac97 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:48.867037 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c56e4e32-37dd-45b4-95f4-4e9bd634ac97 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.152675 May 10 17:46:48.867703 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 171/350] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:48 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:48.881838 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-827320aa-9d64-4ce6-88dd-cae83427d5a3 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:48.882630 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-827320aa-9d64-4ce6-88dd-cae83427d5a3 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:48.889032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-827320aa-9d64-4ce6-88dd-cae83427d5a3 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:48.889507 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-827320aa-9d64-4ce6-88dd-cae83427d5a3 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:48.890280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-827320aa-9d64-4ce6-88dd-cae83427d5a3 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:48.890718 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-827320aa-9d64-4ce6-88dd-cae83427d5a3 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:49.037330 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-827320aa-9d64-4ce6-88dd-cae83427d5a3 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:49.045408 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-827320aa-9d64-4ce6-88dd-cae83427d5a3 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.168044 May 10 17:46:49.045985 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 180/351] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:48 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:49.449739 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-fd3d4553-a515-46c4-9126-a8f9aef65790 req-1294d130-0aac-4bec-8e3d-9bb7e67f4d2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858afd1f-cdd5-4c30-b255-155c40b54fb0", "name": "network-vif-plugged", "status": "completed", "tag": "8eeae9a2-0065-4b4b-9a97-c00de1868cf2"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:46:49.466107 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-fd3d4553-a515-46c4-9126-a8f9aef65790 req-1294d130-0aac-4bec-8e3d-9bb7e67f4d2f service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:49.467263 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-fd3d4553-a515-46c4-9126-a8f9aef65790 req-1294d130-0aac-4bec-8e3d-9bb7e67f4d2f service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:49.488794 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-fd3d4553-a515-46c4-9126-a8f9aef65790 req-1294d130-0aac-4bec-8e3d-9bb7e67f4d2f service nova] Creating event network-vif-plugged:8eeae9a2-0065-4b4b-9a97-c00de1868cf2 for instance 858afd1f-cdd5-4c30-b255-155c40b54fb0 on hv-cinder-84130 May 10 17:46:49.499851 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-fd3d4553-a515-46c4-9126-a8f9aef65790 req-1294d130-0aac-4bec-8e3d-9bb7e67f4d2f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056995 May 10 17:46:49.501071 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-eca9440e-7146-413b-bd08-96dc8ebe5109 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:49.501708 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-eca9440e-7146-413b-bd08-96dc8ebe5109 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:49.501852 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 172/352] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:46:49.512773 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-eca9440e-7146-413b-bd08-96dc8ebe5109 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:49.513322 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-eca9440e-7146-413b-bd08-96dc8ebe5109 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:49.514134 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-eca9440e-7146-413b-bd08-96dc8ebe5109 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:49.514603 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-eca9440e-7146-413b-bd08-96dc8ebe5109 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:49.657445 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-eca9440e-7146-413b-bd08-96dc8ebe5109 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:49.665424 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-eca9440e-7146-413b-bd08-96dc8ebe5109 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1503 microversion: 2.1 time: 0.170098 May 10 17:46:49.665996 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 181/353] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:49 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:49.885405 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b4fcbf23-a020-44e5-8c1a-3c918b6b7ac9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:49.886117 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b4fcbf23-a020-44e5-8c1a-3c918b6b7ac9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:49.893171 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b4fcbf23-a020-44e5-8c1a-3c918b6b7ac9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:49.893682 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b4fcbf23-a020-44e5-8c1a-3c918b6b7ac9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:49.894648 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b4fcbf23-a020-44e5-8c1a-3c918b6b7ac9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:49.895392 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b4fcbf23-a020-44e5-8c1a-3c918b6b7ac9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:50.036003 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b4fcbf23-a020-44e5-8c1a-3c918b6b7ac9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:50.045219 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b4fcbf23-a020-44e5-8c1a-3c918b6b7ac9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.164588 May 10 17:46:50.045832 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 173/354] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:49 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:50.062373 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-484d265e-68cf-4516-a4b0-ccaee16dafd0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:50.062884 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-484d265e-68cf-4516-a4b0-ccaee16dafd0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:50.068867 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-484d265e-68cf-4516-a4b0-ccaee16dafd0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:50.069313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-484d265e-68cf-4516-a4b0-ccaee16dafd0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:50.070133 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-484d265e-68cf-4516-a4b0-ccaee16dafd0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:50.070673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-484d265e-68cf-4516-a4b0-ccaee16dafd0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:50.218933 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-484d265e-68cf-4516-a4b0-ccaee16dafd0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:50.227106 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-484d265e-68cf-4516-a4b0-ccaee16dafd0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.168472 May 10 17:46:50.227768 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 182/355] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:50 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:50.685396 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c06b0b57-e311-4666-b829-b6f5b6f7c59e tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:50.686152 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c06b0b57-e311-4666-b829-b6f5b6f7c59e tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:50.692482 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c06b0b57-e311-4666-b829-b6f5b6f7c59e tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:50.693321 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c06b0b57-e311-4666-b829-b6f5b6f7c59e tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:50.694402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c06b0b57-e311-4666-b829-b6f5b6f7c59e tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:50.695158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c06b0b57-e311-4666-b829-b6f5b6f7c59e tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:50.903620 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c06b0b57-e311-4666-b829-b6f5b6f7c59e tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:50.911614 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c06b0b57-e311-4666-b829-b6f5b6f7c59e tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1503 microversion: 2.1 time: 0.231677 May 10 17:46:50.912073 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 174/356] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:50 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1503 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:51.063535 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-43860de9-c5e8-485b-ac17-45e26a96c639 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:51.064803 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-43860de9-c5e8-485b-ac17-45e26a96c639 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:51.077787 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-43860de9-c5e8-485b-ac17-45e26a96c639 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:51.078627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-43860de9-c5e8-485b-ac17-45e26a96c639 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:51.079679 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-43860de9-c5e8-485b-ac17-45e26a96c639 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:51.080341 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-43860de9-c5e8-485b-ac17-45e26a96c639 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:51.159905 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-dd6578e9-fca7-41f3-8663-d9dfcda5a53f req-43f615f7-5cd9-4df7-932d-010a42ce49ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb", "name": "network-vif-deleted", "tag": "4a82bcea-cd65-4970-a74d-ed9e14c9779d"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:46:51.176539 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-dd6578e9-fca7-41f3-8663-d9dfcda5a53f req-43f615f7-5cd9-4df7-932d-010a42ce49ac service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:51.177343 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-dd6578e9-fca7-41f3-8663-d9dfcda5a53f req-43f615f7-5cd9-4df7-932d-010a42ce49ac service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:51.191836 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-dd6578e9-fca7-41f3-8663-d9dfcda5a53f req-43f615f7-5cd9-4df7-932d-010a42ce49ac service nova] Creating event network-vif-deleted:4a82bcea-cd65-4970-a74d-ed9e14c9779d for instance e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb on hv-cinder-84130 May 10 17:46:51.198125 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-dd6578e9-fca7-41f3-8663-d9dfcda5a53f req-43f615f7-5cd9-4df7-932d-010a42ce49ac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045372 May 10 17:46:51.199508 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 175/357] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:46:51.244985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f96ca7d4-6f27-4f7e-8478-bf0e480640a6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:51.245701 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f96ca7d4-6f27-4f7e-8478-bf0e480640a6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:51.253062 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f96ca7d4-6f27-4f7e-8478-bf0e480640a6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:51.253467 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f96ca7d4-6f27-4f7e-8478-bf0e480640a6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:51.254331 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f96ca7d4-6f27-4f7e-8478-bf0e480640a6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:51.254799 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f96ca7d4-6f27-4f7e-8478-bf0e480640a6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:51.333094 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-43860de9-c5e8-485b-ac17-45e26a96c639 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:51.352243 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-43860de9-c5e8-485b-ac17-45e26a96c639 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.291401 May 10 17:46:51.362540 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 183/358] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:51 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:51.461496 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f96ca7d4-6f27-4f7e-8478-bf0e480640a6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:51.470199 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f96ca7d4-6f27-4f7e-8478-bf0e480640a6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.230854 May 10 17:46:51.470982 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 176/359] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:51 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:51.933129 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1c0f4585-277a-49c0-b9ca-938a88dc23e2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:51.933760 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-1c0f4585-277a-49c0-b9ca-938a88dc23e2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:51.940805 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1c0f4585-277a-49c0-b9ca-938a88dc23e2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:51.941261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1c0f4585-277a-49c0-b9ca-938a88dc23e2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:51.942157 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1c0f4585-277a-49c0-b9ca-938a88dc23e2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:51.942594 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1c0f4585-277a-49c0-b9ca-938a88dc23e2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:52.027492 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1c0f4585-277a-49c0-b9ca-938a88dc23e2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:52.035556 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-1c0f4585-277a-49c0-b9ca-938a88dc23e2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1298 microversion: 2.1 time: 0.109080 May 10 17:46:52.036137 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 184/360] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:51 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1298 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:52.369581 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bd5413ee-7ac2-4911-9c6f-d74c23a39fed tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:52.370104 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-bd5413ee-7ac2-4911-9c6f-d74c23a39fed tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:52.377072 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bd5413ee-7ac2-4911-9c6f-d74c23a39fed tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:52.377526 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bd5413ee-7ac2-4911-9c6f-d74c23a39fed tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:52.378611 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bd5413ee-7ac2-4911-9c6f-d74c23a39fed tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:52.379056 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bd5413ee-7ac2-4911-9c6f-d74c23a39fed tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:52.488463 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7cfd3712-e46a-41d0-b283-738964174c98 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:52.489716 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7cfd3712-e46a-41d0-b283-738964174c98 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:52.496932 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7cfd3712-e46a-41d0-b283-738964174c98 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:52.497386 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7cfd3712-e46a-41d0-b283-738964174c98 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:52.498330 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7cfd3712-e46a-41d0-b283-738964174c98 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:52.498928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7cfd3712-e46a-41d0-b283-738964174c98 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:52.525589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-bd5413ee-7ac2-4911-9c6f-d74c23a39fed tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:52.533612 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bd5413ee-7ac2-4911-9c6f-d74c23a39fed tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.168996 May 10 17:46:52.534447 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 177/361] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:52 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:52.671166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7cfd3712-e46a-41d0-b283-738964174c98 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:52.684023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7cfd3712-e46a-41d0-b283-738964174c98 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1318 microversion: 2.1 time: 0.197379 May 10 17:46:52.684889 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 185/362] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:52 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:53.053283 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-87ca5caf-93bc-429c-ba92-8064740bc4c8 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:53.053891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-87ca5caf-93bc-429c-ba92-8064740bc4c8 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:53.060159 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-87ca5caf-93bc-429c-ba92-8064740bc4c8 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:53.060614 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-87ca5caf-93bc-429c-ba92-8064740bc4c8 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:53.061379 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-87ca5caf-93bc-429c-ba92-8064740bc4c8 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:53.061816 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-87ca5caf-93bc-429c-ba92-8064740bc4c8 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:53.096254 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-87ca5caf-93bc-429c-ba92-8064740bc4c8 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:53.097140 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-87ca5caf-93bc-429c-ba92-8064740bc4c8 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:53.097427 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-87ca5caf-93bc-429c-ba92-8064740bc4c8 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lazy-loading 'fault' on Instance uuid e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:46:53.143984 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-87ca5caf-93bc-429c-ba92-8064740bc4c8 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:53.152630 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-87ca5caf-93bc-429c-ba92-8064740bc4c8 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 200 len: 1303 microversion: 2.1 time: 0.103235 May 10 17:46:53.153137 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 178/363] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:53 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:53.551382 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e9e1aae9-ffe1-4b78-8b90-7e6a30ec897b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:53.552012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e9e1aae9-ffe1-4b78-8b90-7e6a30ec897b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:53.558901 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e9e1aae9-ffe1-4b78-8b90-7e6a30ec897b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:53.559353 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e9e1aae9-ffe1-4b78-8b90-7e6a30ec897b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:53.560172 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e9e1aae9-ffe1-4b78-8b90-7e6a30ec897b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:53.560590 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e9e1aae9-ffe1-4b78-8b90-7e6a30ec897b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:53.691756 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e9e1aae9-ffe1-4b78-8b90-7e6a30ec897b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:53.702854 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-95dd966d-607a-4883-8d60-1130a42f4baa tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:53.703516 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-95dd966d-607a-4883-8d60-1130a42f4baa tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:53.704028 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e9e1aae9-ffe1-4b78-8b90-7e6a30ec897b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.156402 May 10 17:46:53.705173 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 186/364] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:53 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:53.710448 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-95dd966d-607a-4883-8d60-1130a42f4baa tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:53.711029 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-95dd966d-607a-4883-8d60-1130a42f4baa tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:53.711829 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-95dd966d-607a-4883-8d60-1130a42f4baa tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:53.712331 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-95dd966d-607a-4883-8d60-1130a42f4baa tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:53.853807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-95dd966d-607a-4883-8d60-1130a42f4baa tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:53.861635 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-95dd966d-607a-4883-8d60-1130a42f4baa tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1508 microversion: 2.1 time: 0.163491 May 10 17:46:53.862208 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 179/365] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:53 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:54.171956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5cc23512-4da1-4686-8c1d-b952bcec32e3 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:54.172592 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5cc23512-4da1-4686-8c1d-b952bcec32e3 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:54.178865 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5cc23512-4da1-4686-8c1d-b952bcec32e3 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:54.179412 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5cc23512-4da1-4686-8c1d-b952bcec32e3 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:54.180995 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5cc23512-4da1-4686-8c1d-b952bcec32e3 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:54.181629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5cc23512-4da1-4686-8c1d-b952bcec32e3 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:54.200760 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-5cc23512-4da1-4686-8c1d-b952bcec32e3 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] HTTP exception thrown: Instance e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb could not be found. May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5cc23512-4da1-4686-8c1d-b952bcec32e3 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Request method failure captured: May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb HTTP/1.1 May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqTY9XJD9kG54vgrdhWmUmmgffvIsSMGlu5WIJ1rnx1yRlIvRBQ-rAglzr-Cgy13Wkaxhl1SQeJJM8J6HoANMkQlWxvFhXnK6dQEEtO49JkcKHlu4ytcw3rcn9Key0ds1Oi-z1OMkjV1220IRfSkBYCNkssSAD6H8J9IvZ68L1p0Tqc May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: 563af4481d544b74bc5afba3f426e7e5 May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-VolumesActionsTest-132291385 May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:46:54.202629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:46:54.204395 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/563af4481d544b74bc5afba3f426e7e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/563af4481d544b74bc5afba3f426e7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_563af4481d544b74bc5afba3f426e7e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/563af4481d544b74bc5afba3f426e7e5"}]}] May 10 17:46:54.204395 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-VolumesActionsTest-132291385 May 10 17:46:54.204395 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: 563af4481d544b74bc5afba3f426e7e5 May 10 17:46:54.204395 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-VolumesActionsTest-132291385 May 10 17:46:54.204395 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-VolumesActionsTest-132291385-project May 10 17:46:54.204395 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:46:54.204395 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:46:54.204395 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: f5a10f7c3b0a41ca8bd08cb83f850c38 May 10 17:46:54.204395 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-VolumesActionsTest-132291385-project May 10 17:46:54.204395 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:46:54.204395 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb could not be found. May 10 17:46:54.204395 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': 'e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb'} May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb could not be found. May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:46:54.205624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:46:54.207010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:46:54.207010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:46:54.207010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:46:54.207010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:46:54.207010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:46:54.207010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:46:54.207010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:46:54.207010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb could not be found. May 10 17:46:54.207010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:46:54.207010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:46:54.207010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:46:54.207010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:46:54.207010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:46:54.207010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:46:54.207010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:46:54.207010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:46:54.207010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb could not be found. May 10 17:46:54.207010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:46:54.208053 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5cc23512-4da1-4686-8c1d-b952bcec32e3 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Returning 404 to user: Instance e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:46:54.208053 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-5cc23512-4da1-4686-8c1d-b952bcec32e3 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb" status: 404 len: 111 microversion: 2.1 time: 0.036299 May 10 17:46:54.208053 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 187/366] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:54 2022] GET /compute/v2.1/servers/e1f166ee-0aee-4fa9-bd70-2e09c68dc2fb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:46:54.348201 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-13681ac3-8ad8-4f1b-b5b0-3b8362483b0a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1333817933", "imageRef": "a7737c62-8029-44aa-8da7-e46fea7607fb", "flavorRef": "452", "networks": [{"uuid": "e3f42295-b917-4bf6-8b9b-62165723f9ed"}]}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:46:54.405728 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-13681ac3-8ad8-4f1b-b5b0-3b8362483b0a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] validate_networks() for [('e3f42295-b917-4bf6-8b9b-62165723f9ed', None, None, None, None, None)] {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:46:54.722000 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7b847277-0769-412c-99c7-9ea60d4b41d1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:54.723222 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7b847277-0769-412c-99c7-9ea60d4b41d1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:54.729683 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7b847277-0769-412c-99c7-9ea60d4b41d1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:54.730330 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7b847277-0769-412c-99c7-9ea60d4b41d1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:54.731090 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7b847277-0769-412c-99c7-9ea60d4b41d1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:54.731548 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7b847277-0769-412c-99c7-9ea60d4b41d1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:54.757925 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-13681ac3-8ad8-4f1b-b5b0-3b8362483b0a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:46:54.758422 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-13681ac3-8ad8-4f1b-b5b0-3b8362483b0a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:46:54.758822 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-13681ac3-8ad8-4f1b-b5b0-3b8362483b0a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:46:54.759224 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-13681ac3-8ad8-4f1b-b5b0-3b8362483b0a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:46:54.759656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-13681ac3-8ad8-4f1b-b5b0-3b8362483b0a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:46:54.769598 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-13681ac3-8ad8-4f1b-b5b0-3b8362483b0a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:54.769951 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-13681ac3-8ad8-4f1b-b5b0-3b8362483b0a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:54.770757 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-13681ac3-8ad8-4f1b-b5b0-3b8362483b0a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:54.771196 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-13681ac3-8ad8-4f1b-b5b0-3b8362483b0a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:54.789257 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-13681ac3-8ad8-4f1b-b5b0-3b8362483b0a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Getting quotas for project 563af4481d544b74bc5afba3f426e7e5. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:46:54.793480 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-13681ac3-8ad8-4f1b-b5b0-3b8362483b0a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Getting quotas for user f5a10f7c3b0a41ca8bd08cb83f850c38 and project 563af4481d544b74bc5afba3f426e7e5. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:46:54.804606 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-13681ac3-8ad8-4f1b-b5b0-3b8362483b0a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:46:54.806881 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-13681ac3-8ad8-4f1b-b5b0-3b8362483b0a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7737c62-8029-44aa-8da7-e46fea7607fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:46:54.859739 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-13681ac3-8ad8-4f1b-b5b0-3b8362483b0a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.515879 May 10 17:46:54.860661 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 180/367] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 17:46:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:46:54.871027 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-115ebdbb-e5ea-4d19-b7d1-71d4d462a4ba tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:54.871714 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-115ebdbb-e5ea-4d19-b7d1-71d4d462a4ba tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:54.879353 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7b847277-0769-412c-99c7-9ea60d4b41d1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:54.896175 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7b847277-0769-412c-99c7-9ea60d4b41d1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.178261 May 10 17:46:54.896763 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 188/368] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:54 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:54.927806 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-115ebdbb-e5ea-4d19-b7d1-71d4d462a4ba tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:54.934970 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-115ebdbb-e5ea-4d19-b7d1-71d4d462a4ba tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1214 microversion: 2.1 time: 0.068488 May 10 17:46:54.935572 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 181/369] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:54 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:55.915917 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4461b749-f576-428b-9f7f-1def47b2bdec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:55.916652 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4461b749-f576-428b-9f7f-1def47b2bdec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:55.922694 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4461b749-f576-428b-9f7f-1def47b2bdec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:55.923148 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4461b749-f576-428b-9f7f-1def47b2bdec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:55.923948 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4461b749-f576-428b-9f7f-1def47b2bdec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:55.924393 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4461b749-f576-428b-9f7f-1def47b2bdec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:55.952963 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-73f2e52d-cba6-4580-88d3-3a41cffc2365 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:55.953591 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-73f2e52d-cba6-4580-88d3-3a41cffc2365 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:55.961890 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-73f2e52d-cba6-4580-88d3-3a41cffc2365 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:55.962341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-73f2e52d-cba6-4580-88d3-3a41cffc2365 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:55.963116 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-73f2e52d-cba6-4580-88d3-3a41cffc2365 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:55.963575 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-73f2e52d-cba6-4580-88d3-3a41cffc2365 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:56.043096 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-73f2e52d-cba6-4580-88d3-3a41cffc2365 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:56.050391 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-73f2e52d-cba6-4580-88d3-3a41cffc2365 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1218 microversion: 2.1 time: 0.101257 May 10 17:46:56.050963 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 182/370] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:55 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:56.080679 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4461b749-f576-428b-9f7f-1def47b2bdec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:56.088906 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4461b749-f576-428b-9f7f-1def47b2bdec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.178369 May 10 17:46:56.089467 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 189/371] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:55 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:57.066973 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9ef61c04-1b84-4a9f-9405-b920a3c772c2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:57.067518 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9ef61c04-1b84-4a9f-9405-b920a3c772c2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:57.074480 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ef61c04-1b84-4a9f-9405-b920a3c772c2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:57.074935 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ef61c04-1b84-4a9f-9405-b920a3c772c2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:57.075759 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ef61c04-1b84-4a9f-9405-b920a3c772c2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:57.076200 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ef61c04-1b84-4a9f-9405-b920a3c772c2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:57.107434 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5249f52a-e518-445c-bab3-9bced28b11d5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:57.108229 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5249f52a-e518-445c-bab3-9bced28b11d5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:57.114356 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5249f52a-e518-445c-bab3-9bced28b11d5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:57.114878 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5249f52a-e518-445c-bab3-9bced28b11d5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:57.115737 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5249f52a-e518-445c-bab3-9bced28b11d5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:57.116253 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5249f52a-e518-445c-bab3-9bced28b11d5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:57.139522 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9ef61c04-1b84-4a9f-9405-b920a3c772c2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:57.146974 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9ef61c04-1b84-4a9f-9405-b920a3c772c2 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1218 microversion: 2.1 time: 0.083915 May 10 17:46:57.147565 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 183/372] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:57 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:57.255237 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-5249f52a-e518-445c-bab3-9bced28b11d5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:57.262768 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-5249f52a-e518-445c-bab3-9bced28b11d5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.159599 May 10 17:46:57.263335 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 190/373] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:57 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:46:58.164954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4544dd3e-4782-4ddf-b437-a3abbdbaef52 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:58.165718 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4544dd3e-4782-4ddf-b437-a3abbdbaef52 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:58.172160 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4544dd3e-4782-4ddf-b437-a3abbdbaef52 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:58.172614 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4544dd3e-4782-4ddf-b437-a3abbdbaef52 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:58.173383 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4544dd3e-4782-4ddf-b437-a3abbdbaef52 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:58.173822 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4544dd3e-4782-4ddf-b437-a3abbdbaef52 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:58.235593 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4544dd3e-4782-4ddf-b437-a3abbdbaef52 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:58.243767 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4544dd3e-4782-4ddf-b437-a3abbdbaef52 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1266 microversion: 2.1 time: 0.083345 May 10 17:46:58.244340 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 184/374] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:58 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:58.279605 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-00cfff86-9b22-4bd7-960c-4fd4c81dcfc5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:58.280213 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-00cfff86-9b22-4bd7-960c-4fd4c81dcfc5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:58.287314 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-00cfff86-9b22-4bd7-960c-4fd4c81dcfc5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:58.287787 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-00cfff86-9b22-4bd7-960c-4fd4c81dcfc5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:58.288628 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-00cfff86-9b22-4bd7-960c-4fd4c81dcfc5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:58.289175 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-00cfff86-9b22-4bd7-960c-4fd4c81dcfc5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:58.436251 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-00cfff86-9b22-4bd7-960c-4fd4c81dcfc5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:58.447031 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-00cfff86-9b22-4bd7-960c-4fd4c81dcfc5 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.171132 May 10 17:46:58.447661 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 191/375] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:58 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:59.261687 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7dc38be1-8b48-46cd-9eae-1d300a6c26a0 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:59.262460 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7dc38be1-8b48-46cd-9eae-1d300a6c26a0 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:59.268883 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7dc38be1-8b48-46cd-9eae-1d300a6c26a0 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:59.269329 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7dc38be1-8b48-46cd-9eae-1d300a6c26a0 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:59.270104 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7dc38be1-8b48-46cd-9eae-1d300a6c26a0 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:59.270530 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7dc38be1-8b48-46cd-9eae-1d300a6c26a0 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:59.339164 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7dc38be1-8b48-46cd-9eae-1d300a6c26a0 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:59.346684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7dc38be1-8b48-46cd-9eae-1d300a6c26a0 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1272 microversion: 2.1 time: 0.089734 May 10 17:46:59.347255 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 185/376] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:59 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:46:59.465140 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9530facb-0032-43bc-bcfb-ca732edb834a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:46:59.465788 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-9530facb-0032-43bc-bcfb-ca732edb834a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:46:59.472278 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9530facb-0032-43bc-bcfb-ca732edb834a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:59.472743 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9530facb-0032-43bc-bcfb-ca732edb834a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:59.473562 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9530facb-0032-43bc-bcfb-ca732edb834a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:46:59.474086 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9530facb-0032-43bc-bcfb-ca732edb834a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:46:59.605274 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-9530facb-0032-43bc-bcfb-ca732edb834a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:46:59.613486 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-9530facb-0032-43bc-bcfb-ca732edb834a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.152700 May 10 17:46:59.614066 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 192/377] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:46:59 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:00.364644 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c9f31040-53b8-4dad-9fef-d74f205118b5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:00.365261 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c9f31040-53b8-4dad-9fef-d74f205118b5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:00.372264 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c9f31040-53b8-4dad-9fef-d74f205118b5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:00.372720 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c9f31040-53b8-4dad-9fef-d74f205118b5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:00.373500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c9f31040-53b8-4dad-9fef-d74f205118b5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:00.373944 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c9f31040-53b8-4dad-9fef-d74f205118b5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:00.439009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c9f31040-53b8-4dad-9fef-d74f205118b5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:00.447385 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c9f31040-53b8-4dad-9fef-d74f205118b5 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1272 microversion: 2.1 time: 0.085645 May 10 17:47:00.447899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 186/378] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:00 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1272 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:00.629789 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a430d2f4-64d2-4344-af76-9018d16241be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:00.630387 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a430d2f4-64d2-4344-af76-9018d16241be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:00.636300 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a430d2f4-64d2-4344-af76-9018d16241be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:00.636747 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a430d2f4-64d2-4344-af76-9018d16241be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:00.637500 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a430d2f4-64d2-4344-af76-9018d16241be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:00.637963 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a430d2f4-64d2-4344-af76-9018d16241be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:00.770341 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a430d2f4-64d2-4344-af76-9018d16241be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:00.780521 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a430d2f4-64d2-4344-af76-9018d16241be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.154350 May 10 17:47:00.781296 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 193/379] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:00 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:01.464375 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2d4a0ae8-be05-476a-a6a3-e40312c20bf9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:01.464980 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2d4a0ae8-be05-476a-a6a3-e40312c20bf9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:01.471482 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2d4a0ae8-be05-476a-a6a3-e40312c20bf9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:01.471935 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2d4a0ae8-be05-476a-a6a3-e40312c20bf9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:01.472709 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2d4a0ae8-be05-476a-a6a3-e40312c20bf9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:01.473151 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2d4a0ae8-be05-476a-a6a3-e40312c20bf9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:01.535772 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2d4a0ae8-be05-476a-a6a3-e40312c20bf9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:01.544279 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2d4a0ae8-be05-476a-a6a3-e40312c20bf9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1272 microversion: 2.1 time: 0.083828 May 10 17:47:01.544890 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 187/380] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:01 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1272 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:01.797732 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-261d067f-6285-49e7-9cf1-f6294e956d09 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:01.798292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-261d067f-6285-49e7-9cf1-f6294e956d09 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:01.804497 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-261d067f-6285-49e7-9cf1-f6294e956d09 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:01.804907 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-261d067f-6285-49e7-9cf1-f6294e956d09 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:01.806229 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-261d067f-6285-49e7-9cf1-f6294e956d09 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:01.806676 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-261d067f-6285-49e7-9cf1-f6294e956d09 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:01.936471 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-261d067f-6285-49e7-9cf1-f6294e956d09 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:01.943787 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-261d067f-6285-49e7-9cf1-f6294e956d09 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.150033 May 10 17:47:01.944345 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 194/381] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:01 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:02.562142 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-039c5460-a37d-441d-9165-27f468c4372f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:02.562691 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-039c5460-a37d-441d-9165-27f468c4372f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:02.569268 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-039c5460-a37d-441d-9165-27f468c4372f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:02.569727 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-039c5460-a37d-441d-9165-27f468c4372f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:02.570507 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-039c5460-a37d-441d-9165-27f468c4372f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:02.570948 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-039c5460-a37d-441d-9165-27f468c4372f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:02.639335 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-039c5460-a37d-441d-9165-27f468c4372f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:02.646947 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-039c5460-a37d-441d-9165-27f468c4372f tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1272 microversion: 2.1 time: 0.089016 May 10 17:47:02.647544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 188/382] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:02 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:02.961367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-bfbd8344-ad8e-40a7-81f2-5808002339f6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:02.961972 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-bfbd8344-ad8e-40a7-81f2-5808002339f6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:02.967941 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bfbd8344-ad8e-40a7-81f2-5808002339f6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:02.968403 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bfbd8344-ad8e-40a7-81f2-5808002339f6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:02.969168 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bfbd8344-ad8e-40a7-81f2-5808002339f6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:02.969606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bfbd8344-ad8e-40a7-81f2-5808002339f6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:03.098412 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-bfbd8344-ad8e-40a7-81f2-5808002339f6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:03.106311 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-bfbd8344-ad8e-40a7-81f2-5808002339f6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.148828 May 10 17:47:03.106879 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 195/383] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:02 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:03.663840 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-07bc1d11-4a20-40ae-ad6c-544353f890a8 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:03.664448 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-07bc1d11-4a20-40ae-ad6c-544353f890a8 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:03.671639 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-07bc1d11-4a20-40ae-ad6c-544353f890a8 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:03.672164 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-07bc1d11-4a20-40ae-ad6c-544353f890a8 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:03.673016 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-07bc1d11-4a20-40ae-ad6c-544353f890a8 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:03.673581 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-07bc1d11-4a20-40ae-ad6c-544353f890a8 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:03.857026 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-07bc1d11-4a20-40ae-ad6c-544353f890a8 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:03.865669 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-07bc1d11-4a20-40ae-ad6c-544353f890a8 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1314 microversion: 2.1 time: 0.205812 May 10 17:47:03.866580 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 189/384] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:03 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:04.122644 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-165a2151-16db-41da-8b70-b35b3af7228b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:04.123224 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-165a2151-16db-41da-8b70-b35b3af7228b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:04.129468 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-165a2151-16db-41da-8b70-b35b3af7228b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:04.129951 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-165a2151-16db-41da-8b70-b35b3af7228b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:04.130764 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-165a2151-16db-41da-8b70-b35b3af7228b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:04.131217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-165a2151-16db-41da-8b70-b35b3af7228b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:04.270796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-165a2151-16db-41da-8b70-b35b3af7228b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:04.279630 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-165a2151-16db-41da-8b70-b35b3af7228b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.160858 May 10 17:47:04.280218 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 196/385] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:04 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:04.648685 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-dd54954e-8e9b-497c-a7f5-c31da798022e req-5d9271aa-c579-4435-bf32-6de38eaa4d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0fcf89c-a78f-4dfe-8e68-f30c210d80c8", "tag": "f2d6a44e-8c8d-4856-b9f1-dede8b83cb88"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:47:04.662910 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-dd54954e-8e9b-497c-a7f5-c31da798022e req-5d9271aa-c579-4435-bf32-6de38eaa4d02 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:04.663526 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-dd54954e-8e9b-497c-a7f5-c31da798022e req-5d9271aa-c579-4435-bf32-6de38eaa4d02 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:04.675345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-dd54954e-8e9b-497c-a7f5-c31da798022e req-5d9271aa-c579-4435-bf32-6de38eaa4d02 service nova] Creating event network-changed:f2d6a44e-8c8d-4856-b9f1-dede8b83cb88 for instance f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 on hv-cinder-84130 May 10 17:47:04.680209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-dd54954e-8e9b-497c-a7f5-c31da798022e req-5d9271aa-c579-4435-bf32-6de38eaa4d02 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036100 May 10 17:47:04.681513 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 190/386] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:47:04.882583 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ec112d42-d6bb-4109-9336-f99167ac5335 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:04.883305 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ec112d42-d6bb-4109-9336-f99167ac5335 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:04.891496 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ec112d42-d6bb-4109-9336-f99167ac5335 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:04.892253 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ec112d42-d6bb-4109-9336-f99167ac5335 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:04.893040 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ec112d42-d6bb-4109-9336-f99167ac5335 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:04.893649 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ec112d42-d6bb-4109-9336-f99167ac5335 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:05.039693 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ec112d42-d6bb-4109-9336-f99167ac5335 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:05.049285 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ec112d42-d6bb-4109-9336-f99167ac5335 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1314 microversion: 2.1 time: 0.170633 May 10 17:47:05.050026 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 197/387] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:04 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:05.297340 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b461d8b8-384e-44a1-9f37-618f2fbc8747 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:05.298057 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b461d8b8-384e-44a1-9f37-618f2fbc8747 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:05.304547 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b461d8b8-384e-44a1-9f37-618f2fbc8747 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:05.304993 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b461d8b8-384e-44a1-9f37-618f2fbc8747 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:05.305787 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b461d8b8-384e-44a1-9f37-618f2fbc8747 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:05.306225 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b461d8b8-384e-44a1-9f37-618f2fbc8747 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:05.443631 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b461d8b8-384e-44a1-9f37-618f2fbc8747 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:05.452163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b461d8b8-384e-44a1-9f37-618f2fbc8747 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.159357 May 10 17:47:05.452871 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 191/388] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:05 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:06.070289 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-26354d11-a18e-4f78-86c0-effebc003b83 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:06.070895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-26354d11-a18e-4f78-86c0-effebc003b83 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:06.082921 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-26354d11-a18e-4f78-86c0-effebc003b83 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:06.083840 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-26354d11-a18e-4f78-86c0-effebc003b83 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:06.085479 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-26354d11-a18e-4f78-86c0-effebc003b83 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:06.086117 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-26354d11-a18e-4f78-86c0-effebc003b83 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:06.252232 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-26354d11-a18e-4f78-86c0-effebc003b83 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:06.260110 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-26354d11-a18e-4f78-86c0-effebc003b83 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1314 microversion: 2.1 time: 0.193598 May 10 17:47:06.260674 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 198/389] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:06 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:06.468886 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1f6a5586-68e0-454c-8eab-6510678e2384 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:06.469601 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1f6a5586-68e0-454c-8eab-6510678e2384 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:06.476119 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1f6a5586-68e0-454c-8eab-6510678e2384 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:06.476572 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1f6a5586-68e0-454c-8eab-6510678e2384 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:06.477482 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1f6a5586-68e0-454c-8eab-6510678e2384 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:06.478152 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1f6a5586-68e0-454c-8eab-6510678e2384 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:06.604466 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1f6a5586-68e0-454c-8eab-6510678e2384 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:06.611796 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1f6a5586-68e0-454c-8eab-6510678e2384 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.146768 May 10 17:47:06.612359 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 192/390] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:06 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:07.278634 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-3a411819-7adf-4a96-8f3c-d52a80f41a17 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:07.279195 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-3a411819-7adf-4a96-8f3c-d52a80f41a17 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:07.287719 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3a411819-7adf-4a96-8f3c-d52a80f41a17 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:07.288174 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3a411819-7adf-4a96-8f3c-d52a80f41a17 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:07.288960 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3a411819-7adf-4a96-8f3c-d52a80f41a17 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:07.289401 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3a411819-7adf-4a96-8f3c-d52a80f41a17 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:07.448049 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-3a411819-7adf-4a96-8f3c-d52a80f41a17 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:07.457006 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-3a411819-7adf-4a96-8f3c-d52a80f41a17 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1314 microversion: 2.1 time: 0.182852 May 10 17:47:07.457600 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 199/391] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:07 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:07.629873 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e480b497-91f8-47e4-bd1c-6eb411161db8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:07.630482 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e480b497-91f8-47e4-bd1c-6eb411161db8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:07.636928 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e480b497-91f8-47e4-bd1c-6eb411161db8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:07.637381 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e480b497-91f8-47e4-bd1c-6eb411161db8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:07.638152 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e480b497-91f8-47e4-bd1c-6eb411161db8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:07.638594 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e480b497-91f8-47e4-bd1c-6eb411161db8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:07.771292 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e480b497-91f8-47e4-bd1c-6eb411161db8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:07.779696 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e480b497-91f8-47e4-bd1c-6eb411161db8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.153562 May 10 17:47:07.780280 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 193/392] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:07 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:08.473906 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e31f1aa1-fefb-4678-8c6a-72240d84796c tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:08.474552 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e31f1aa1-fefb-4678-8c6a-72240d84796c tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:08.481163 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e31f1aa1-fefb-4678-8c6a-72240d84796c tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:08.481615 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e31f1aa1-fefb-4678-8c6a-72240d84796c tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:08.482405 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e31f1aa1-fefb-4678-8c6a-72240d84796c tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:08.482840 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e31f1aa1-fefb-4678-8c6a-72240d84796c tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:08.642392 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e31f1aa1-fefb-4678-8c6a-72240d84796c tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:08.650780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e31f1aa1-fefb-4678-8c6a-72240d84796c tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1314 microversion: 2.1 time: 0.180674 May 10 17:47:08.651376 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 200/393] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:08 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:08.798293 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-88cc2893-8ebc-46f3-ba02-4f78eb1b9e23 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:08.798904 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-88cc2893-8ebc-46f3-ba02-4f78eb1b9e23 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:08.805877 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-88cc2893-8ebc-46f3-ba02-4f78eb1b9e23 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:08.806332 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-88cc2893-8ebc-46f3-ba02-4f78eb1b9e23 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:08.807250 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-88cc2893-8ebc-46f3-ba02-4f78eb1b9e23 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:08.807704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-88cc2893-8ebc-46f3-ba02-4f78eb1b9e23 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:09.004031 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-88cc2893-8ebc-46f3-ba02-4f78eb1b9e23 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:09.012215 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-88cc2893-8ebc-46f3-ba02-4f78eb1b9e23 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.217880 May 10 17:47:09.012821 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 194/394] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:08 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:09.668465 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7553eb8d-3fda-49b0-a22e-6734dd907251 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:09.669255 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7553eb8d-3fda-49b0-a22e-6734dd907251 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:09.675899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7553eb8d-3fda-49b0-a22e-6734dd907251 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:09.676353 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7553eb8d-3fda-49b0-a22e-6734dd907251 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:09.677127 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7553eb8d-3fda-49b0-a22e-6734dd907251 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:09.677564 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7553eb8d-3fda-49b0-a22e-6734dd907251 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:09.839108 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7553eb8d-3fda-49b0-a22e-6734dd907251 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:09.856177 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7553eb8d-3fda-49b0-a22e-6734dd907251 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1314 microversion: 2.1 time: 0.189906 May 10 17:47:09.858275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 201/395] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:09 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:10.028983 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a3b43273-935e-40cf-a0dd-db96ed7f6d5c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:10.029600 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a3b43273-935e-40cf-a0dd-db96ed7f6d5c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:10.042981 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a3b43273-935e-40cf-a0dd-db96ed7f6d5c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:10.044104 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a3b43273-935e-40cf-a0dd-db96ed7f6d5c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:10.045173 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a3b43273-935e-40cf-a0dd-db96ed7f6d5c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:10.045851 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a3b43273-935e-40cf-a0dd-db96ed7f6d5c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:10.252481 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a3b43273-935e-40cf-a0dd-db96ed7f6d5c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:10.268679 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a3b43273-935e-40cf-a0dd-db96ed7f6d5c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.242585 May 10 17:47:10.276387 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 195/396] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:10 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:10.876237 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-d1ee3607-7f08-47e1-9ca4-667e52e9bd09 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:10.876890 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-d1ee3607-7f08-47e1-9ca4-667e52e9bd09 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:10.884660 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d1ee3607-7f08-47e1-9ca4-667e52e9bd09 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:10.886405 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d1ee3607-7f08-47e1-9ca4-667e52e9bd09 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:10.886944 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d1ee3607-7f08-47e1-9ca4-667e52e9bd09 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:10.887625 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d1ee3607-7f08-47e1-9ca4-667e52e9bd09 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:11.040820 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-d1ee3607-7f08-47e1-9ca4-667e52e9bd09 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:11.048516 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-d1ee3607-7f08-47e1-9ca4-667e52e9bd09 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1314 microversion: 2.1 time: 0.176772 May 10 17:47:11.049093 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 202/397] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:10 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:11.288593 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-173a0fd5-2e0e-4d4c-91b7-9a26f8a8e8ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:11.289142 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-173a0fd5-2e0e-4d4c-91b7-9a26f8a8e8ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:11.296249 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-173a0fd5-2e0e-4d4c-91b7-9a26f8a8e8ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:11.297176 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-173a0fd5-2e0e-4d4c-91b7-9a26f8a8e8ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:11.297498 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-173a0fd5-2e0e-4d4c-91b7-9a26f8a8e8ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:11.297955 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-173a0fd5-2e0e-4d4c-91b7-9a26f8a8e8ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:11.443886 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-173a0fd5-2e0e-4d4c-91b7-9a26f8a8e8ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:11.452053 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-173a0fd5-2e0e-4d4c-91b7-9a26f8a8e8ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.167877 May 10 17:47:11.452634 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 196/398] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:11 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:12.066723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4e327ad2-e6d5-484e-886d-5344588c8f30 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:12.067341 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4e327ad2-e6d5-484e-886d-5344588c8f30 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:12.070236 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-46a25ea0-d0d3-4e88-86d8-21d3b610c00b req-e0c36f0c-f5d8-4014-9c5a-b20ce80d1a23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fcf89c-a78f-4dfe-8e68-f30c210d80c8", "name": "network-vif-plugged", "status": "completed", "tag": "f2d6a44e-8c8d-4856-b9f1-dede8b83cb88"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:47:12.075082 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e327ad2-e6d5-484e-886d-5344588c8f30 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:12.075588 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e327ad2-e6d5-484e-886d-5344588c8f30 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:12.076401 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e327ad2-e6d5-484e-886d-5344588c8f30 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:12.076845 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e327ad2-e6d5-484e-886d-5344588c8f30 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:12.079808 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-46a25ea0-d0d3-4e88-86d8-21d3b610c00b req-e0c36f0c-f5d8-4014-9c5a-b20ce80d1a23 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:12.080434 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-46a25ea0-d0d3-4e88-86d8-21d3b610c00b req-e0c36f0c-f5d8-4014-9c5a-b20ce80d1a23 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:12.094826 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-46a25ea0-d0d3-4e88-86d8-21d3b610c00b req-e0c36f0c-f5d8-4014-9c5a-b20ce80d1a23 service nova] Creating event network-vif-plugged:f2d6a44e-8c8d-4856-b9f1-dede8b83cb88 for instance f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 on hv-cinder-84130 May 10 17:47:12.101319 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-46a25ea0-d0d3-4e88-86d8-21d3b610c00b req-e0c36f0c-f5d8-4014-9c5a-b20ce80d1a23 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034540 May 10 17:47:12.102081 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 197/399] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:47:12.263456 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4e327ad2-e6d5-484e-886d-5344588c8f30 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:12.277734 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4e327ad2-e6d5-484e-886d-5344588c8f30 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1314 microversion: 2.1 time: 0.214990 May 10 17:47:12.278322 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 203/400] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:12 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:12.470151 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-528fe0b7-0145-4464-98b7-f514f78cfbdd tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:12.470988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-528fe0b7-0145-4464-98b7-f514f78cfbdd tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:12.478755 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-528fe0b7-0145-4464-98b7-f514f78cfbdd tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:12.479428 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-528fe0b7-0145-4464-98b7-f514f78cfbdd tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:12.480230 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-528fe0b7-0145-4464-98b7-f514f78cfbdd tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:12.480666 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-528fe0b7-0145-4464-98b7-f514f78cfbdd tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:12.640584 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-528fe0b7-0145-4464-98b7-f514f78cfbdd tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:12.648405 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-528fe0b7-0145-4464-98b7-f514f78cfbdd tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.183008 May 10 17:47:12.648999 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 198/401] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:12 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:13.297208 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8af064e0-964e-484e-8be1-631cee8b973a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:13.298410 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8af064e0-964e-484e-8be1-631cee8b973a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:13.310200 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8af064e0-964e-484e-8be1-631cee8b973a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:13.310650 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8af064e0-964e-484e-8be1-631cee8b973a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:13.311506 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8af064e0-964e-484e-8be1-631cee8b973a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:13.311949 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8af064e0-964e-484e-8be1-631cee8b973a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:13.483244 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-8af064e0-964e-484e-8be1-631cee8b973a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:13.490824 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8af064e0-964e-484e-8be1-631cee8b973a tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1314 microversion: 2.1 time: 0.197963 May 10 17:47:13.491413 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 204/402] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:13 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:13.667314 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-079025e6-b76f-4002-a94b-ca68af09d98a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:13.667956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-079025e6-b76f-4002-a94b-ca68af09d98a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:13.674179 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-079025e6-b76f-4002-a94b-ca68af09d98a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:13.674634 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-079025e6-b76f-4002-a94b-ca68af09d98a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:13.675445 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-079025e6-b76f-4002-a94b-ca68af09d98a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:13.675919 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-079025e6-b76f-4002-a94b-ca68af09d98a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:13.818942 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-079025e6-b76f-4002-a94b-ca68af09d98a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:13.827239 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-079025e6-b76f-4002-a94b-ca68af09d98a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.166173 May 10 17:47:13.827855 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 199/403] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:13 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:14.507398 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a90ffb5a-b328-4480-ae66-faf6aca32e77 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:14.508034 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a90ffb5a-b328-4480-ae66-faf6aca32e77 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:14.516512 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a90ffb5a-b328-4480-ae66-faf6aca32e77 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:14.517300 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a90ffb5a-b328-4480-ae66-faf6aca32e77 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:14.518707 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a90ffb5a-b328-4480-ae66-faf6aca32e77 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:14.519531 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a90ffb5a-b328-4480-ae66-faf6aca32e77 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:14.667805 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a90ffb5a-b328-4480-ae66-faf6aca32e77 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:14.675902 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a90ffb5a-b328-4480-ae66-faf6aca32e77 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1314 microversion: 2.1 time: 0.172377 May 10 17:47:14.676677 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 205/404] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:14 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:47:14.845067 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f4753c1b-1974-4c3f-93ee-aae703066a83 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:14.845592 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f4753c1b-1974-4c3f-93ee-aae703066a83 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:14.851644 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f4753c1b-1974-4c3f-93ee-aae703066a83 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:14.852112 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f4753c1b-1974-4c3f-93ee-aae703066a83 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:14.853587 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f4753c1b-1974-4c3f-93ee-aae703066a83 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:14.854037 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f4753c1b-1974-4c3f-93ee-aae703066a83 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:14.990303 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f4753c1b-1974-4c3f-93ee-aae703066a83 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:14.999380 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f4753c1b-1974-4c3f-93ee-aae703066a83 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.158575 May 10 17:47:14.999969 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 200/405] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:14 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:15.695647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4856d09f-51e6-4ca2-88f7-ccd7d59e4112 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:15.697339 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4856d09f-51e6-4ca2-88f7-ccd7d59e4112 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:15.703506 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4856d09f-51e6-4ca2-88f7-ccd7d59e4112 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:15.703971 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4856d09f-51e6-4ca2-88f7-ccd7d59e4112 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:15.704879 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4856d09f-51e6-4ca2-88f7-ccd7d59e4112 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:15.705368 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4856d09f-51e6-4ca2-88f7-ccd7d59e4112 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:15.857639 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4856d09f-51e6-4ca2-88f7-ccd7d59e4112 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:15.872667 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4856d09f-51e6-4ca2-88f7-ccd7d59e4112 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1498 microversion: 2.1 time: 0.181113 May 10 17:47:15.873775 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 206/406] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:15 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1498 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:16.018144 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-acd9b134-d1aa-45a3-9cd0-122f21c988c1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:16.019213 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-acd9b134-d1aa-45a3-9cd0-122f21c988c1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:16.027214 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-acd9b134-d1aa-45a3-9cd0-122f21c988c1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:16.027697 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-acd9b134-d1aa-45a3-9cd0-122f21c988c1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:16.028491 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-acd9b134-d1aa-45a3-9cd0-122f21c988c1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:16.028993 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-acd9b134-d1aa-45a3-9cd0-122f21c988c1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:16.178537 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-acd9b134-d1aa-45a3-9cd0-122f21c988c1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:16.186998 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-acd9b134-d1aa-45a3-9cd0-122f21c988c1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.173924 May 10 17:47:16.187731 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 201/407] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:16 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:16.578055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-91d8b41b-8024-4766-b749-2bc390ffa2a7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:16.578613 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-91d8b41b-8024-4766-b749-2bc390ffa2a7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:16.585439 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-91d8b41b-8024-4766-b749-2bc390ffa2a7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:16.585892 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-91d8b41b-8024-4766-b749-2bc390ffa2a7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:16.587246 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-91d8b41b-8024-4766-b749-2bc390ffa2a7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:16.588028 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-91d8b41b-8024-4766-b749-2bc390ffa2a7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:16.623463 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-91d8b41b-8024-4766-b749-2bc390ffa2a7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Going to try to terminate instance {{(pid=123753) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:47:16.725852 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-91d8b41b-8024-4766-b749-2bc390ffa2a7 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 204 len: 0 microversion: 2.1 time: 0.151945 May 10 17:47:16.726671 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 207/408] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:47:16 2022] DELETE /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:47:16.734916 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-696e77e1-4d82-4658-a862-70ff05297dc1 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:16.735553 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-696e77e1-4d82-4658-a862-70ff05297dc1 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:16.742336 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-696e77e1-4d82-4658-a862-70ff05297dc1 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:16.743670 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-696e77e1-4d82-4658-a862-70ff05297dc1 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:16.744512 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-696e77e1-4d82-4658-a862-70ff05297dc1 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:16.744951 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-696e77e1-4d82-4658-a862-70ff05297dc1 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:16.898651 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-696e77e1-4d82-4658-a862-70ff05297dc1 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:16.908347 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-696e77e1-4d82-4658-a862-70ff05297dc1 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1504 microversion: 2.1 time: 0.177127 May 10 17:47:16.909183 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 202/409] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:16 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:47:17.206275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-95981faa-b877-4a4b-9f19-05062e2c257d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:17.206966 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-95981faa-b877-4a4b-9f19-05062e2c257d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:17.213919 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-95981faa-b877-4a4b-9f19-05062e2c257d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:17.214368 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-95981faa-b877-4a4b-9f19-05062e2c257d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:17.215160 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-95981faa-b877-4a4b-9f19-05062e2c257d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:17.215627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-95981faa-b877-4a4b-9f19-05062e2c257d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:17.361742 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-95981faa-b877-4a4b-9f19-05062e2c257d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:17.370150 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-95981faa-b877-4a4b-9f19-05062e2c257d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.167944 May 10 17:47:17.370766 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 208/410] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:17 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:17.926675 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-78f90ac9-56e3-44f1-a479-71c5ab3f76a9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:17.927276 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-78f90ac9-56e3-44f1-a479-71c5ab3f76a9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:17.934539 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-78f90ac9-56e3-44f1-a479-71c5ab3f76a9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:17.934985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-78f90ac9-56e3-44f1-a479-71c5ab3f76a9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:17.935794 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-78f90ac9-56e3-44f1-a479-71c5ab3f76a9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:17.936226 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-78f90ac9-56e3-44f1-a479-71c5ab3f76a9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:18.073763 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-78f90ac9-56e3-44f1-a479-71c5ab3f76a9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:18.081167 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-78f90ac9-56e3-44f1-a479-71c5ab3f76a9 tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1504 microversion: 2.1 time: 0.158445 May 10 17:47:18.081742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 203/411] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:17 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:18.388346 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-d8a53578-ec98-43e6-8dc1-9c5bde883333 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:18.388984 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-d8a53578-ec98-43e6-8dc1-9c5bde883333 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:18.395512 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d8a53578-ec98-43e6-8dc1-9c5bde883333 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:18.395993 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d8a53578-ec98-43e6-8dc1-9c5bde883333 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:18.396775 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d8a53578-ec98-43e6-8dc1-9c5bde883333 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:18.397262 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d8a53578-ec98-43e6-8dc1-9c5bde883333 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:18.552316 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-d8a53578-ec98-43e6-8dc1-9c5bde883333 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:18.563550 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-d8a53578-ec98-43e6-8dc1-9c5bde883333 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.179416 May 10 17:47:18.567440 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 209/412] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:18 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:47:19.099486 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5b9b5d19-25f4-4762-be1d-20d4ec68be6c tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:19.100227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5b9b5d19-25f4-4762-be1d-20d4ec68be6c tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:19.108407 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5b9b5d19-25f4-4762-be1d-20d4ec68be6c tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:19.109185 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5b9b5d19-25f4-4762-be1d-20d4ec68be6c tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:19.113332 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5b9b5d19-25f4-4762-be1d-20d4ec68be6c tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:19.113332 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5b9b5d19-25f4-4762-be1d-20d4ec68be6c tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:19.263795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5b9b5d19-25f4-4762-be1d-20d4ec68be6c tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5a10f7c3b0a41ca8bd08cb83f850c38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '563af4481d544b74bc5afba3f426e7e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:19.279875 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5b9b5d19-25f4-4762-be1d-20d4ec68be6c tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 200 len: 1504 microversion: 2.1 time: 0.184698 May 10 17:47:19.281115 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 204/413] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:19 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 1504 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:19.581845 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8003f554-8ec4-4e02-92eb-73fac1e47c98 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:19.582467 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8003f554-8ec4-4e02-92eb-73fac1e47c98 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:19.590238 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8003f554-8ec4-4e02-92eb-73fac1e47c98 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:19.590765 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8003f554-8ec4-4e02-92eb-73fac1e47c98 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:19.591762 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8003f554-8ec4-4e02-92eb-73fac1e47c98 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:19.592398 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8003f554-8ec4-4e02-92eb-73fac1e47c98 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:19.597796 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-8bfb13fd-5e8a-496d-bb42-e0e0d58bf886 req-5c04a390-f2a6-4685-b471-ec2da3fd2f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0fcf89c-a78f-4dfe-8e68-f30c210d80c8", "name": "network-vif-deleted", "tag": "f2d6a44e-8c8d-4856-b9f1-dede8b83cb88"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:47:19.609301 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-8bfb13fd-5e8a-496d-bb42-e0e0d58bf886 req-5c04a390-f2a6-4685-b471-ec2da3fd2f8b service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:19.609748 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-8bfb13fd-5e8a-496d-bb42-e0e0d58bf886 req-5c04a390-f2a6-4685-b471-ec2da3fd2f8b service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:19.625942 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-8bfb13fd-5e8a-496d-bb42-e0e0d58bf886 req-5c04a390-f2a6-4685-b471-ec2da3fd2f8b service nova] Creating event network-vif-deleted:f2d6a44e-8c8d-4856-b9f1-dede8b83cb88 for instance f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 on hv-cinder-84130 May 10 17:47:19.632443 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-8bfb13fd-5e8a-496d-bb42-e0e0d58bf886 req-5c04a390-f2a6-4685-b471-ec2da3fd2f8b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040025 May 10 17:47:19.633861 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 205/414] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:47:19.750245 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-8003f554-8ec4-4e02-92eb-73fac1e47c98 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:19.757544 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8003f554-8ec4-4e02-92eb-73fac1e47c98 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.179741 May 10 17:47:19.758107 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 210/415] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:19 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:20.310484 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-900a6a3e-79b9-4cea-8a8b-d01f1e6de70e tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:20.311434 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-900a6a3e-79b9-4cea-8a8b-d01f1e6de70e tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] [instance: f0fcf89c-a78f-4dfe-8e68-f30c210d80c8] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:20.317673 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-900a6a3e-79b9-4cea-8a8b-d01f1e6de70e tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:20.318185 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-900a6a3e-79b9-4cea-8a8b-d01f1e6de70e tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:20.319092 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-900a6a3e-79b9-4cea-8a8b-d01f1e6de70e tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:20.319564 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-900a6a3e-79b9-4cea-8a8b-d01f1e6de70e tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:20.335350 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-900a6a3e-79b9-4cea-8a8b-d01f1e6de70e tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] HTTP exception thrown: Instance f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 could not be found. May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-900a6a3e-79b9-4cea-8a8b-d01f1e6de70e tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Request method failure captured: May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 HTTP/1.1 May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqTY9XJD9kG54vgrdhWmUmmgffvIsSMGlu5WIJ1rnx1yRlIvRBQ-rAglzr-Cgy13Wkaxhl1SQeJJM8J6HoANMkQlWxvFhXnK6dQEEtO49JkcKHlu4ytcw3rcn9Key0ds1Oi-z1OMkjV1220IRfSkBYCNkssSAD6H8J9IvZ68L1p0Tqc May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: 563af4481d544b74bc5afba3f426e7e5 May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-VolumesActionsTest-132291385 May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:47:20.337458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:47:20.339037 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/563af4481d544b74bc5afba3f426e7e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/563af4481d544b74bc5afba3f426e7e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_563af4481d544b74bc5afba3f426e7e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/563af4481d544b74bc5afba3f426e7e5"}]}] May 10 17:47:20.339037 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-VolumesActionsTest-132291385 May 10 17:47:20.339037 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 563af4481d544b74bc5afba3f426e7e5 May 10 17:47:20.339037 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-VolumesActionsTest-132291385 May 10 17:47:20.339037 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-VolumesActionsTest-132291385-project May 10 17:47:20.339037 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:47:20.339037 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:47:20.339037 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: f5a10f7c3b0a41ca8bd08cb83f850c38 May 10 17:47:20.339037 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-VolumesActionsTest-132291385-project May 10 17:47:20.339037 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:47:20.339037 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 could not be found. May 10 17:47:20.339037 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': 'f0fcf89c-a78f-4dfe-8e68-f30c210d80c8'} May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 could not be found. May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:47:20.339917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:47:20.341304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:47:20.341304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:47:20.341304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:47:20.341304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:47:20.341304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:47:20.341304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:47:20.341304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:47:20.341304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 could not be found. May 10 17:47:20.341304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:47:20.341304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:47:20.341304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:47:20.341304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:47:20.341304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:47:20.341304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:47:20.341304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:47:20.341304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:47:20.341304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 could not be found. May 10 17:47:20.341304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:47:20.342479 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-900a6a3e-79b9-4cea-8a8b-d01f1e6de70e tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] Returning 404 to user: Instance f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:47:20.342479 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-900a6a3e-79b9-4cea-8a8b-d01f1e6de70e tempest-VolumesActionsTest-132291385 tempest-VolumesActionsTest-132291385-project] 10.222.0.60 "GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8" status: 404 len: 111 microversion: 2.1 time: 0.033853 May 10 17:47:20.342479 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 206/416] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:20 2022] GET /compute/v2.1/servers/f0fcf89c-a78f-4dfe-8e68-f30c210d80c8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:47:20.776236 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-6621a053-d97a-4856-9d17-42143857eae3 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:20.776858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-6621a053-d97a-4856-9d17-42143857eae3 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:20.783341 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6621a053-d97a-4856-9d17-42143857eae3 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:20.783822 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6621a053-d97a-4856-9d17-42143857eae3 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:20.784595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6621a053-d97a-4856-9d17-42143857eae3 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:20.785033 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6621a053-d97a-4856-9d17-42143857eae3 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:20.941515 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6621a053-d97a-4856-9d17-42143857eae3 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:20.948942 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-6621a053-d97a-4856-9d17-42143857eae3 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.177291 May 10 17:47:20.950170 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 211/417] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:20 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:21.966427 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-38ceafad-ae3e-4c09-af3b-32a5e2aa92a8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:21.975823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-38ceafad-ae3e-4c09-af3b-32a5e2aa92a8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:21.983960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38ceafad-ae3e-4c09-af3b-32a5e2aa92a8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:21.984519 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38ceafad-ae3e-4c09-af3b-32a5e2aa92a8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:21.985391 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38ceafad-ae3e-4c09-af3b-32a5e2aa92a8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:21.985907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-38ceafad-ae3e-4c09-af3b-32a5e2aa92a8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:22.126307 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-38ceafad-ae3e-4c09-af3b-32a5e2aa92a8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:22.133867 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-38ceafad-ae3e-4c09-af3b-32a5e2aa92a8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.171441 May 10 17:47:22.134530 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 207/418] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:21 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:23.151602 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-73a19ff2-d52f-4268-894b-fa395fce5038 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:23.152132 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-73a19ff2-d52f-4268-894b-fa395fce5038 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:23.158162 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-73a19ff2-d52f-4268-894b-fa395fce5038 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:23.158622 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-73a19ff2-d52f-4268-894b-fa395fce5038 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:23.159422 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-73a19ff2-d52f-4268-894b-fa395fce5038 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:23.159867 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-73a19ff2-d52f-4268-894b-fa395fce5038 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:23.297556 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-73a19ff2-d52f-4268-894b-fa395fce5038 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:23.305738 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-73a19ff2-d52f-4268-894b-fa395fce5038 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.158274 May 10 17:47:23.306318 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 212/419] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:23 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:24.322951 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-edb4daf6-a4c2-44c0-bc18-627e8e6ad129 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:24.323653 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-edb4daf6-a4c2-44c0-bc18-627e8e6ad129 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:24.330312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-edb4daf6-a4c2-44c0-bc18-627e8e6ad129 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:24.330769 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-edb4daf6-a4c2-44c0-bc18-627e8e6ad129 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:24.331585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-edb4daf6-a4c2-44c0-bc18-627e8e6ad129 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:24.332025 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-edb4daf6-a4c2-44c0-bc18-627e8e6ad129 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:24.465263 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-edb4daf6-a4c2-44c0-bc18-627e8e6ad129 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:24.472679 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-edb4daf6-a4c2-44c0-bc18-627e8e6ad129 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.154454 May 10 17:47:24.473249 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 208/420] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:24 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:25.489668 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ff7c7f5d-8527-46d2-92f4-da6f93ca12ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:25.490266 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ff7c7f5d-8527-46d2-92f4-da6f93ca12ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:25.497314 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ff7c7f5d-8527-46d2-92f4-da6f93ca12ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:25.497767 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ff7c7f5d-8527-46d2-92f4-da6f93ca12ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:25.498543 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ff7c7f5d-8527-46d2-92f4-da6f93ca12ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:25.498979 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ff7c7f5d-8527-46d2-92f4-da6f93ca12ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:25.633060 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ff7c7f5d-8527-46d2-92f4-da6f93ca12ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:25.641674 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ff7c7f5d-8527-46d2-92f4-da6f93ca12ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.155864 May 10 17:47:25.642249 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 213/421] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:25 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:26.661104 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-60e501dc-e0fa-4145-9011-fd704a4f2d3f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:26.661788 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-60e501dc-e0fa-4145-9011-fd704a4f2d3f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:26.670101 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-60e501dc-e0fa-4145-9011-fd704a4f2d3f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:26.670553 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-60e501dc-e0fa-4145-9011-fd704a4f2d3f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:26.671337 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-60e501dc-e0fa-4145-9011-fd704a4f2d3f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:26.671807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-60e501dc-e0fa-4145-9011-fd704a4f2d3f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:26.796203 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-60e501dc-e0fa-4145-9011-fd704a4f2d3f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:26.803631 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-60e501dc-e0fa-4145-9011-fd704a4f2d3f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.147431 May 10 17:47:26.804197 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 209/422] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:26 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:27.822458 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-cb5facc8-e748-4fef-aea2-bbada13d9480 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:27.822972 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-cb5facc8-e748-4fef-aea2-bbada13d9480 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:27.828984 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cb5facc8-e748-4fef-aea2-bbada13d9480 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:27.829435 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cb5facc8-e748-4fef-aea2-bbada13d9480 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:27.830198 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cb5facc8-e748-4fef-aea2-bbada13d9480 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:27.830630 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cb5facc8-e748-4fef-aea2-bbada13d9480 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:27.965604 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-cb5facc8-e748-4fef-aea2-bbada13d9480 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:27.973229 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-cb5facc8-e748-4fef-aea2-bbada13d9480 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.155673 May 10 17:47:27.973807 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 214/423] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:27 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:28.990173 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d229d012-1c50-4260-a15d-5d91b1bd4751 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:28.990787 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d229d012-1c50-4260-a15d-5d91b1bd4751 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:28.997661 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d229d012-1c50-4260-a15d-5d91b1bd4751 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:28.998121 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d229d012-1c50-4260-a15d-5d91b1bd4751 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:28.998898 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d229d012-1c50-4260-a15d-5d91b1bd4751 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:28.999338 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d229d012-1c50-4260-a15d-5d91b1bd4751 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:29.140934 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d229d012-1c50-4260-a15d-5d91b1bd4751 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:29.151226 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d229d012-1c50-4260-a15d-5d91b1bd4751 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.164862 May 10 17:47:29.152149 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 210/424] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:28 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:30.168065 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-90a17648-d960-4c2e-8144-60e93d53ff0b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:30.168679 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-90a17648-d960-4c2e-8144-60e93d53ff0b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:30.174496 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-90a17648-d960-4c2e-8144-60e93d53ff0b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:30.174946 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-90a17648-d960-4c2e-8144-60e93d53ff0b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:30.175753 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-90a17648-d960-4c2e-8144-60e93d53ff0b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:30.176196 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-90a17648-d960-4c2e-8144-60e93d53ff0b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:30.303311 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-90a17648-d960-4c2e-8144-60e93d53ff0b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:30.311318 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-90a17648-d960-4c2e-8144-60e93d53ff0b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.147798 May 10 17:47:30.311915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 215/425] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:30 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:31.331431 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-72605541-de65-4023-994b-d049ebef02d1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:31.332905 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-72605541-de65-4023-994b-d049ebef02d1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:31.340154 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-72605541-de65-4023-994b-d049ebef02d1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:31.340613 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-72605541-de65-4023-994b-d049ebef02d1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:31.341398 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-72605541-de65-4023-994b-d049ebef02d1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:31.342267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-72605541-de65-4023-994b-d049ebef02d1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:31.559557 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-72605541-de65-4023-994b-d049ebef02d1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:31.569029 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-72605541-de65-4023-994b-d049ebef02d1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.243853 May 10 17:47:31.572864 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 211/426] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:31 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:32.598166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-6876fb29-37b9-4894-adae-8188be4b16ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:32.598820 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-6876fb29-37b9-4894-adae-8188be4b16ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:32.607139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6876fb29-37b9-4894-adae-8188be4b16ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:32.607718 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6876fb29-37b9-4894-adae-8188be4b16ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:32.608703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6876fb29-37b9-4894-adae-8188be4b16ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:32.609314 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6876fb29-37b9-4894-adae-8188be4b16ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:32.845566 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6876fb29-37b9-4894-adae-8188be4b16ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:32.853977 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-6876fb29-37b9-4894-adae-8188be4b16ee tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.261012 May 10 17:47:32.854807 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 216/427] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:32 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:33.870661 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c4498cfd-f3d3-401a-a5d8-e1e2b3a1a002 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:33.873065 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c4498cfd-f3d3-401a-a5d8-e1e2b3a1a002 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:33.880387 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c4498cfd-f3d3-401a-a5d8-e1e2b3a1a002 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:33.880954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c4498cfd-f3d3-401a-a5d8-e1e2b3a1a002 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:33.881967 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c4498cfd-f3d3-401a-a5d8-e1e2b3a1a002 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:33.882469 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c4498cfd-f3d3-401a-a5d8-e1e2b3a1a002 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:34.066786 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c4498cfd-f3d3-401a-a5d8-e1e2b3a1a002 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:34.076588 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c4498cfd-f3d3-401a-a5d8-e1e2b3a1a002 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.210345 May 10 17:47:34.077438 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 212/428] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:33 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:35.094762 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c8c37032-8877-4d2f-a54a-dddfa001c813 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:35.095641 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c8c37032-8877-4d2f-a54a-dddfa001c813 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:35.103042 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c8c37032-8877-4d2f-a54a-dddfa001c813 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:35.103609 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c8c37032-8877-4d2f-a54a-dddfa001c813 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:35.104316 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c8c37032-8877-4d2f-a54a-dddfa001c813 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:35.104755 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c8c37032-8877-4d2f-a54a-dddfa001c813 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:35.485660 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c8c37032-8877-4d2f-a54a-dddfa001c813 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:35.494945 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c8c37032-8877-4d2f-a54a-dddfa001c813 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1501 microversion: 2.1 time: 0.404434 May 10 17:47:35.499457 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 217/429] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:35 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1501 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:35.514632 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c80b2211-4de2-4cd6-8088-60dda2e65102 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79a1716b-ac51-417a-84c8-3d0373051992"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:47:35.515927 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c80b2211-4de2-4cd6-8088-60dda2e65102 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:35.526685 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c80b2211-4de2-4cd6-8088-60dda2e65102 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:35.527239 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c80b2211-4de2-4cd6-8088-60dda2e65102 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:35.528141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c80b2211-4de2-4cd6-8088-60dda2e65102 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:35.528653 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c80b2211-4de2-4cd6-8088-60dda2e65102 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:35.557090 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-c80b2211-4de2-4cd6-8088-60dda2e65102 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] HTTP exception thrown: Cannot 'attach_volume' instance c1bf8bc9-b3de-4555-8835-15dd3a89bc56 while it is in vm_state rescued May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c80b2211-4de2-4cd6-8088-60dda2e65102 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Request method failure captured: May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: POST /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56/os-volume_attachments HTTP/1.1 May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 74 May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqSOYGFPOd_dSxQaw1xfXQL_oNPyInp9GeEXMVahMzSoBYuT3KiscvPKi3HBhjiWcLRLnDswKdZfNWCZzA6zRi1fmpAEigHOnkwk7Hg_h3oQ0KqrQ-oT8nZjHwnyBn82tUZ647WdoHFkg0oukih8HeJ54y7rT7g4d_iUCDyYKQuR3Xs May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: ec9da2f35bcd444fa485c453103df5cc May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1659970125 May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:47:35.559124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:47:35.560750 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec9da2f35bcd444fa485c453103df5cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ec9da2f35bcd444fa485c453103df5cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ec9da2f35bcd444fa485c453103df5cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec9da2f35bcd444fa485c453103df5cc"}]}] May 10 17:47:35.560750 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1659970125 May 10 17:47:35.560750 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: ec9da2f35bcd444fa485c453103df5cc May 10 17:47:35.560750 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1659970125 May 10 17:47:35.560750 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-ServerRescueNegativeTestJSON-1659970125-project May 10 17:47:35.560750 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:47:35.560750 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:47:35.560750 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: 93f2755bf7ac430f9380bf2cf3ecb97f May 10 17:47:35.560750 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1659970125-project May 10 17:47:35.560750 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: May 10 17:47:35.560750 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {"volumeAttachment": {"volumeId": "79a1716b-ac51-417a-84c8-3d0373051992"}} May 10 17:47:35.560750 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:47:35.561677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Cannot 'attach_volume' instance c1bf8bc9-b3de-4555-8835-15dd3a89bc56 while it is in vm_state rescued May 10 17:47:35.561677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'server_id': 'c1bf8bc9-b3de-4555-8835-15dd3a89bc56', 'body': {'volumeAttachment': {'volumeId': '79a1716b-ac51-417a-84c8-3d0373051992'}}} May 10 17:47:35.561677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:47:35.561677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:47:35.561677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 17:47:35.561677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 17:47:35.561677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 17:47:35.561677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 17:47:35.561677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 17:47:35.561677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 17:47:35.561677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c1bf8bc9-b3de-4555-8835-15dd3a89bc56 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 10 17:47:35.561677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:47:35.561677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:47:35.561677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:47:35.561677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:47:35.561677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:47:35.561677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:47:35.561677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:47:35.561677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:47:35.563077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:47:35.563077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:47:35.563077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 17:47:35.563077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 17:47:35.563077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 17:47:35.563077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 17:47:35.563077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 17:47:35.563077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 17:47:35.563077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 10 17:47:35.563077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 17:47:35.563077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 17:47:35.563077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 17:47:35.563077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c1bf8bc9-b3de-4555-8835-15dd3a89bc56 while it is in vm_state rescued May 10 17:47:35.563077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:47:35.563077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:47:35.563077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:47:35.563077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:47:35.563077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:47:35.563077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:47:35.564453 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:47:35.564453 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:47:35.564453 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c1bf8bc9-b3de-4555-8835-15dd3a89bc56 while it is in vm_state rescued May 10 17:47:35.564453 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:47:35.566022 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c80b2211-4de2-4cd6-8088-60dda2e65102 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Returning 409 to user: Cannot 'attach_volume' instance c1bf8bc9-b3de-4555-8835-15dd3a89bc56 while it is in vm_state rescued {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:47:35.567140 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c80b2211-4de2-4cd6-8088-60dda2e65102 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "POST /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.056805 May 10 17:47:35.568678 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 213/430] 10.222.0.60 () {60 vars in 1322 bytes} [Tue May 10 17:47:35 2022] POST /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 17:47:35.585947 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-cd3f2548-e038-40dc-b0d8-00704e4378dc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:47:35.588020 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-cd3f2548-e038-40dc-b0d8-00704e4378dc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:35.602070 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cd3f2548-e038-40dc-b0d8-00704e4378dc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:35.604078 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cd3f2548-e038-40dc-b0d8-00704e4378dc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:35.605935 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cd3f2548-e038-40dc-b0d8-00704e4378dc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:35.607099 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cd3f2548-e038-40dc-b0d8-00704e4378dc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:35.735008 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-cd3f2548-e038-40dc-b0d8-00704e4378dc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "POST /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56/action" status: 202 len: 0 microversion: 2.1 time: 0.156775 May 10 17:47:35.738661 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 218/431] 10.222.0.60 () {60 vars in 1277 bytes} [Tue May 10 17:47:35 2022] POST /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:47:35.746495 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9b6a5e8b-c5fd-4914-88dd-af5baeb52047 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:35.747664 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9b6a5e8b-c5fd-4914-88dd-af5baeb52047 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:35.768174 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b6a5e8b-c5fd-4914-88dd-af5baeb52047 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:35.768647 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b6a5e8b-c5fd-4914-88dd-af5baeb52047 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:35.769676 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b6a5e8b-c5fd-4914-88dd-af5baeb52047 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:35.770410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b6a5e8b-c5fd-4914-88dd-af5baeb52047 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:35.939222 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9b6a5e8b-c5fd-4914-88dd-af5baeb52047 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:35.955134 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9b6a5e8b-c5fd-4914-88dd-af5baeb52047 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1509 microversion: 2.1 time: 0.213979 May 10 17:47:35.959401 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 214/432] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:35 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:36.978563 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c2fc7f44-d584-402c-94f0-dcf3da71c445 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:36.979528 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c2fc7f44-d584-402c-94f0-dcf3da71c445 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:36.986690 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c2fc7f44-d584-402c-94f0-dcf3da71c445 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:36.987514 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c2fc7f44-d584-402c-94f0-dcf3da71c445 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:36.988534 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c2fc7f44-d584-402c-94f0-dcf3da71c445 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:36.989182 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c2fc7f44-d584-402c-94f0-dcf3da71c445 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:37.147093 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c2fc7f44-d584-402c-94f0-dcf3da71c445 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:37.156339 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c2fc7f44-d584-402c-94f0-dcf3da71c445 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1509 microversion: 2.1 time: 0.183114 May 10 17:47:37.157322 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 219/433] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:36 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:47:38.182843 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e19815e9-7e1f-4fca-b431-029fb321fe47 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:38.183645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e19815e9-7e1f-4fca-b431-029fb321fe47 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:38.190539 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e19815e9-7e1f-4fca-b431-029fb321fe47 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:38.190996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e19815e9-7e1f-4fca-b431-029fb321fe47 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:38.191835 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e19815e9-7e1f-4fca-b431-029fb321fe47 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:38.192284 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e19815e9-7e1f-4fca-b431-029fb321fe47 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:38.354477 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e19815e9-7e1f-4fca-b431-029fb321fe47 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:38.363122 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e19815e9-7e1f-4fca-b431-029fb321fe47 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1509 microversion: 2.1 time: 0.184636 May 10 17:47:38.364344 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 215/434] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:38 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:39.388527 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-30b922ae-1eeb-457e-9ee3-63d736d105c8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:39.390108 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-30b922ae-1eeb-457e-9ee3-63d736d105c8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:39.400003 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-30b922ae-1eeb-457e-9ee3-63d736d105c8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:39.401027 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-30b922ae-1eeb-457e-9ee3-63d736d105c8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:39.402467 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-30b922ae-1eeb-457e-9ee3-63d736d105c8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:39.403203 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-30b922ae-1eeb-457e-9ee3-63d736d105c8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:39.634360 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-30b922ae-1eeb-457e-9ee3-63d736d105c8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:39.644179 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-30b922ae-1eeb-457e-9ee3-63d736d105c8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1509 microversion: 2.1 time: 0.264068 May 10 17:47:39.659930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 220/435] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:39 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1509 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:40.670097 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-56bfee7d-008f-4fcd-bfa4-6a54b157db30 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:40.670764 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-56bfee7d-008f-4fcd-bfa4-6a54b157db30 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:40.678113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-56bfee7d-008f-4fcd-bfa4-6a54b157db30 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:40.678567 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-56bfee7d-008f-4fcd-bfa4-6a54b157db30 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:40.679383 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-56bfee7d-008f-4fcd-bfa4-6a54b157db30 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:40.680395 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-56bfee7d-008f-4fcd-bfa4-6a54b157db30 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:40.824483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-56bfee7d-008f-4fcd-bfa4-6a54b157db30 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:40.836907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-56bfee7d-008f-4fcd-bfa4-6a54b157db30 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1515 microversion: 2.1 time: 0.169731 May 10 17:47:40.837886 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 216/436] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:40 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:43.578266 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2d1e54f5-2171-4878-9744-5ca1f943467c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Action: 'create', calling method: .version_select at 0x7f3e76a49940>, body: {"keypair": {"name": "tempest-keypair-1631421927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXLvs0CY2wR4fLqJQvvqWiuvDJnel3Zj5b59RPX2jCPx0zgX4O1IluAKQ71H1BtinyjT8iKjdIw65N7BVPjUZbgNpUlVw5qHWgjbpvmbRFJl5kWehicx/+mOTCaLnG3ow=="}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:47:43.616218 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-2d1e54f5-2171-4878-9744-5ca1f943467c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Getting quotas for project ec9da2f35bcd444fa485c453103df5cc. Resources: {'key_pairs'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:47:43.635516 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-2d1e54f5-2171-4878-9744-5ca1f943467c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Getting quotas for user 93f2755bf7ac430f9380bf2cf3ecb97f and project ec9da2f35bcd444fa485c453103df5cc. Resources: {'key_pairs'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:47:43.679195 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-2d1e54f5-2171-4878-9744-5ca1f943467c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.104717 May 10 17:47:43.681069 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 221/437] 10.222.0.60 () {60 vars in 1158 bytes} [Tue May 10 17:47:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:47:45.935067 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f72a6073-5094-4cd7-88ea-62f42b436e0d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-435218834", "imageRef": "a7737c62-8029-44aa-8da7-e46fea7607fb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f37a5a11-05c8-4d32-b0a0-13874a53c216"}], "security_groups": [{"name": "tempest-securitygroup--906963544"}], "key_name": "tempest-keypair-1631421927", "user_data": "}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:47:46.142028 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-f72a6073-5094-4cd7-88ea-62f42b436e0d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] validate_networks() for [('f37a5a11-05c8-4d32-b0a0-13874a53c216', None, None, None, None, None)] {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:47:46.797192 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-f72a6073-5094-4cd7-88ea-62f42b436e0d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:47:46.797956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-f72a6073-5094-4cd7-88ea-62f42b436e0d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:47:46.798558 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-f72a6073-5094-4cd7-88ea-62f42b436e0d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:47:46.799093 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-f72a6073-5094-4cd7-88ea-62f42b436e0d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:47:46.799696 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-f72a6073-5094-4cd7-88ea-62f42b436e0d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:47:46.817262 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f72a6073-5094-4cd7-88ea-62f42b436e0d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:46.817790 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f72a6073-5094-4cd7-88ea-62f42b436e0d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:46.818923 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f72a6073-5094-4cd7-88ea-62f42b436e0d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:46.819648 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f72a6073-5094-4cd7-88ea-62f42b436e0d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:46.842485 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-f72a6073-5094-4cd7-88ea-62f42b436e0d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Getting quotas for project ec9da2f35bcd444fa485c453103df5cc. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:47:46.849291 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-f72a6073-5094-4cd7-88ea-62f42b436e0d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Getting quotas for user 93f2755bf7ac430f9380bf2cf3ecb97f and project ec9da2f35bcd444fa485c453103df5cc. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:47:46.865329 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f72a6073-5094-4cd7-88ea-62f42b436e0d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:47:46.868364 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f72a6073-5094-4cd7-88ea-62f42b436e0d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7737c62-8029-44aa-8da7-e46fea7607fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:47:46.931891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f72a6073-5094-4cd7-88ea-62f42b436e0d tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.004536 May 10 17:47:46.932944 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 217/438] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 17:47:45 2022] POST /compute/v2.1/servers => generated 408 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:47:46.950851 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-bb122687-d679-4b19-9bfd-ea4d481abb02 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:46.952965 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-bb122687-d679-4b19-9bfd-ea4d481abb02 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:47.056757 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-bb122687-d679-4b19-9bfd-ea4d481abb02 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:47.065052 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-bb122687-d679-4b19-9bfd-ea4d481abb02 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1245 microversion: 2.1 time: 0.123828 May 10 17:47:47.066061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 222/439] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:46 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1245 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:48.087567 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-83c56df7-dbde-418a-8cdc-b608da156d64 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:48.088318 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-83c56df7-dbde-418a-8cdc-b608da156d64 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:48.095894 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-83c56df7-dbde-418a-8cdc-b608da156d64 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:48.096568 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-83c56df7-dbde-418a-8cdc-b608da156d64 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:48.097414 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-83c56df7-dbde-418a-8cdc-b608da156d64 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:48.097861 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-83c56df7-dbde-418a-8cdc-b608da156d64 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:48.201790 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-83c56df7-dbde-418a-8cdc-b608da156d64 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:48.210297 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-83c56df7-dbde-418a-8cdc-b608da156d64 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1241 microversion: 2.1 time: 0.127910 May 10 17:47:48.213096 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 218/440] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:48 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1241 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:49.238512 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-99114f0f-1db3-43b1-9680-cfab58ddbef2 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:49.240937 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-99114f0f-1db3-43b1-9680-cfab58ddbef2 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:49.265304 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-99114f0f-1db3-43b1-9680-cfab58ddbef2 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:49.278484 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-99114f0f-1db3-43b1-9680-cfab58ddbef2 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:49.280574 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-99114f0f-1db3-43b1-9680-cfab58ddbef2 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:49.281782 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-99114f0f-1db3-43b1-9680-cfab58ddbef2 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:49.397206 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-99114f0f-1db3-43b1-9680-cfab58ddbef2 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:49.409485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-99114f0f-1db3-43b1-9680-cfab58ddbef2 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1305 microversion: 2.1 time: 0.182109 May 10 17:47:49.410740 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 223/441] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:49 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1305 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:50.442767 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-360705a5-28b4-46a8-9b39-8cfd2a249bf7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:50.445168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-360705a5-28b4-46a8-9b39-8cfd2a249bf7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:50.453741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-360705a5-28b4-46a8-9b39-8cfd2a249bf7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:50.455171 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-360705a5-28b4-46a8-9b39-8cfd2a249bf7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:50.456433 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-360705a5-28b4-46a8-9b39-8cfd2a249bf7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:50.457073 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-360705a5-28b4-46a8-9b39-8cfd2a249bf7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:50.853854 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-360705a5-28b4-46a8-9b39-8cfd2a249bf7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:50.886492 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-360705a5-28b4-46a8-9b39-8cfd2a249bf7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1370 microversion: 2.1 time: 0.449446 May 10 17:47:50.891443 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 219/442] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:50 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1370 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:51.914092 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-acdcc1c1-9ace-4f55-9dd1-2fb0a8e840e1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:51.915553 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-acdcc1c1-9ace-4f55-9dd1-2fb0a8e840e1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:51.927329 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-acdcc1c1-9ace-4f55-9dd1-2fb0a8e840e1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:51.928171 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-acdcc1c1-9ace-4f55-9dd1-2fb0a8e840e1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:51.930128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-acdcc1c1-9ace-4f55-9dd1-2fb0a8e840e1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:51.930885 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-acdcc1c1-9ace-4f55-9dd1-2fb0a8e840e1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:51.986979 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-cc687836-06cc-493a-be3f-183e55a39356 req-bf152a6b-229f-4257-af3e-f11b1079e603 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4553a66-9c17-4820-a5ab-1e3f45b42cb2", "tag": "d41cfb7a-6772-4a26-bd70-17d9a9faa38c"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:47:51.998156 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-cc687836-06cc-493a-be3f-183e55a39356 req-bf152a6b-229f-4257-af3e-f11b1079e603 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:51.998607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-cc687836-06cc-493a-be3f-183e55a39356 req-bf152a6b-229f-4257-af3e-f11b1079e603 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:52.029131 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-cc687836-06cc-493a-be3f-183e55a39356 req-bf152a6b-229f-4257-af3e-f11b1079e603 service nova] Creating event network-changed:d41cfb7a-6772-4a26-bd70-17d9a9faa38c for instance e4553a66-9c17-4820-a5ab-1e3f45b42cb2 on hv-cinder-84130 May 10 17:47:52.042480 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-cc687836-06cc-493a-be3f-183e55a39356 req-bf152a6b-229f-4257-af3e-f11b1079e603 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059272 May 10 17:47:52.043139 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 220/443] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:47:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:47:52.130954 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-acdcc1c1-9ace-4f55-9dd1-2fb0a8e840e1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:52.142342 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-acdcc1c1-9ace-4f55-9dd1-2fb0a8e840e1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1370 microversion: 2.1 time: 0.238534 May 10 17:47:52.143038 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 224/444] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:51 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1370 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:53.163924 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b02e7b54-7542-4c83-9386-18969f2d3f8b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:53.165129 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b02e7b54-7542-4c83-9386-18969f2d3f8b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:53.173426 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b02e7b54-7542-4c83-9386-18969f2d3f8b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:53.173883 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b02e7b54-7542-4c83-9386-18969f2d3f8b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:53.174700 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b02e7b54-7542-4c83-9386-18969f2d3f8b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:53.175146 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b02e7b54-7542-4c83-9386-18969f2d3f8b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:53.331906 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b02e7b54-7542-4c83-9386-18969f2d3f8b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:53.346123 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b02e7b54-7542-4c83-9386-18969f2d3f8b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1370 microversion: 2.1 time: 0.189939 May 10 17:47:53.346725 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 221/445] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:53 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:54.006075 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-d68d8f31-2911-4fef-b7d9-f4ba61199ad7 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89b723b4-259f-4605-a128-486d6e7e2253", "device": "/dev/sdb"}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:47:54.008206 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-d68d8f31-2911-4fef-b7d9-f4ba61199ad7 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:54.017290 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d68d8f31-2911-4fef-b7d9-f4ba61199ad7 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:54.018120 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d68d8f31-2911-4fef-b7d9-f4ba61199ad7 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:54.019517 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d68d8f31-2911-4fef-b7d9-f4ba61199ad7 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:54.020280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d68d8f31-2911-4fef-b7d9-f4ba61199ad7 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:54.364536 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-176df004-2c7c-4165-b008-11bbc8e5f5af tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:54.365178 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-176df004-2c7c-4165-b008-11bbc8e5f5af tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:54.373294 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-176df004-2c7c-4165-b008-11bbc8e5f5af tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:54.373752 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-176df004-2c7c-4165-b008-11bbc8e5f5af tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:54.374554 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-176df004-2c7c-4165-b008-11bbc8e5f5af tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:54.375002 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-176df004-2c7c-4165-b008-11bbc8e5f5af tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:54.541244 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-176df004-2c7c-4165-b008-11bbc8e5f5af tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:54.550128 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-176df004-2c7c-4165-b008-11bbc8e5f5af tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1370 microversion: 2.1 time: 0.189729 May 10 17:47:54.550733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 222/446] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:54 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:47:55.568970 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6fc2cfd3-0caa-461f-9e03-7f3a5ce9bce8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:55.570600 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6fc2cfd3-0caa-461f-9e03-7f3a5ce9bce8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:55.577778 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6fc2cfd3-0caa-461f-9e03-7f3a5ce9bce8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:55.578236 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6fc2cfd3-0caa-461f-9e03-7f3a5ce9bce8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:55.579039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6fc2cfd3-0caa-461f-9e03-7f3a5ce9bce8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:55.579502 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6fc2cfd3-0caa-461f-9e03-7f3a5ce9bce8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:55.730343 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6fc2cfd3-0caa-461f-9e03-7f3a5ce9bce8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:55.737994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6fc2cfd3-0caa-461f-9e03-7f3a5ce9bce8 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1370 microversion: 2.1 time: 0.174354 May 10 17:47:55.738576 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 223/447] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:55 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:47:56.756336 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0733c40f-5389-4b6e-9af0-6e565d9ec99a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:56.757051 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0733c40f-5389-4b6e-9af0-6e565d9ec99a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:56.763863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0733c40f-5389-4b6e-9af0-6e565d9ec99a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:56.764322 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0733c40f-5389-4b6e-9af0-6e565d9ec99a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:56.765120 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0733c40f-5389-4b6e-9af0-6e565d9ec99a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:56.765546 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0733c40f-5389-4b6e-9af0-6e565d9ec99a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:57.046436 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-d68d8f31-2911-4fef-b7d9-f4ba61199ad7 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "POST /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.044583 May 10 17:47:57.052250 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 225/448] 10.222.0.60 () {60 vars in 1322 bytes} [Tue May 10 17:47:53 2022] POST /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0/os-volume_attachments => generated 194 bytes in 3051 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:47:57.093832 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0733c40f-5389-4b6e-9af0-6e565d9ec99a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:57.112759 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0733c40f-5389-4b6e-9af0-6e565d9ec99a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1370 microversion: 2.1 time: 0.360665 May 10 17:47:57.113802 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 224/449] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:56 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1370 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:47:58.152981 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-d57e4837-e5f9-435a-9658-66f0223a89e7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:58.154914 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-d57e4837-e5f9-435a-9658-66f0223a89e7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:58.167761 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d57e4837-e5f9-435a-9658-66f0223a89e7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:58.168492 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d57e4837-e5f9-435a-9658-66f0223a89e7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:58.170086 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d57e4837-e5f9-435a-9658-66f0223a89e7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:58.170989 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d57e4837-e5f9-435a-9658-66f0223a89e7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:58.338504 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-d57e4837-e5f9-435a-9658-66f0223a89e7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:58.348778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-d57e4837-e5f9-435a-9658-66f0223a89e7 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1370 microversion: 2.1 time: 0.206296 May 10 17:47:58.349447 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 226/450] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:58 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1370 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:47:59.366202 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-178ebde1-b430-4ee0-9f81-4bdc45576b22 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:47:59.369083 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-178ebde1-b430-4ee0-9f81-4bdc45576b22 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:47:59.374811 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-178ebde1-b430-4ee0-9f81-4bdc45576b22 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:59.375352 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-178ebde1-b430-4ee0-9f81-4bdc45576b22 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:59.376363 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-178ebde1-b430-4ee0-9f81-4bdc45576b22 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:47:59.376898 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-178ebde1-b430-4ee0-9f81-4bdc45576b22 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:47:59.539048 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-178ebde1-b430-4ee0-9f81-4bdc45576b22 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:47:59.548412 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-178ebde1-b430-4ee0-9f81-4bdc45576b22 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1370 microversion: 2.1 time: 0.186121 May 10 17:47:59.548997 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 225/451] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:47:59 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1370 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:00.070346 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-4b95b4c1-d021-4c30-9e2e-41a1969b3916 req-f8d8925e-2c7f-4e94-b98a-336a6151c82d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4553a66-9c17-4820-a5ab-1e3f45b42cb2", "name": "network-vif-plugged", "status": "completed", "tag": "d41cfb7a-6772-4a26-bd70-17d9a9faa38c"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:48:00.081006 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-4b95b4c1-d021-4c30-9e2e-41a1969b3916 req-f8d8925e-2c7f-4e94-b98a-336a6151c82d service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:00.081451 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-4b95b4c1-d021-4c30-9e2e-41a1969b3916 req-f8d8925e-2c7f-4e94-b98a-336a6151c82d service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:00.095830 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-4b95b4c1-d021-4c30-9e2e-41a1969b3916 req-f8d8925e-2c7f-4e94-b98a-336a6151c82d service nova] Creating event network-vif-plugged:d41cfb7a-6772-4a26-bd70-17d9a9faa38c for instance e4553a66-9c17-4820-a5ab-1e3f45b42cb2 on hv-cinder-84130 May 10 17:48:00.102128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-4b95b4c1-d021-4c30-9e2e-41a1969b3916 req-f8d8925e-2c7f-4e94-b98a-336a6151c82d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035010 May 10 17:48:00.102911 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 227/452] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:48:00.565954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-16e6f660-b3e8-42e4-be32-1d442744665e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:00.566485 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-16e6f660-b3e8-42e4-be32-1d442744665e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:00.574000 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-16e6f660-b3e8-42e4-be32-1d442744665e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:00.574401 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-16e6f660-b3e8-42e4-be32-1d442744665e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:00.575186 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-16e6f660-b3e8-42e4-be32-1d442744665e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:00.575660 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-16e6f660-b3e8-42e4-be32-1d442744665e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:00.722955 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-16e6f660-b3e8-42e4-be32-1d442744665e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:00.731419 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-16e6f660-b3e8-42e4-be32-1d442744665e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1370 microversion: 2.1 time: 0.169296 May 10 17:48:00.732011 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 226/453] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:00 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1370 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:01.752649 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-15d2139b-7755-49a3-a0bc-4d304f6c91ea tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:01.753499 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-15d2139b-7755-49a3-a0bc-4d304f6c91ea tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:01.763604 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-15d2139b-7755-49a3-a0bc-4d304f6c91ea tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:01.764339 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-15d2139b-7755-49a3-a0bc-4d304f6c91ea tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:01.765618 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-15d2139b-7755-49a3-a0bc-4d304f6c91ea tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:01.766362 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-15d2139b-7755-49a3-a0bc-4d304f6c91ea tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:01.915037 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-15d2139b-7755-49a3-a0bc-4d304f6c91ea tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:01.922592 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-15d2139b-7755-49a3-a0bc-4d304f6c91ea tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1370 microversion: 2.1 time: 0.174438 May 10 17:48:01.923090 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 228/454] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:01 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:02.940411 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-00096043-c48a-43ac-afeb-b1097ea5c5ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:02.940938 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-00096043-c48a-43ac-afeb-b1097ea5c5ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:02.949802 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-00096043-c48a-43ac-afeb-b1097ea5c5ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:02.950267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-00096043-c48a-43ac-afeb-b1097ea5c5ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:02.951062 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-00096043-c48a-43ac-afeb-b1097ea5c5ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:02.951547 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-00096043-c48a-43ac-afeb-b1097ea5c5ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:03.137357 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-00096043-c48a-43ac-afeb-b1097ea5c5ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:03.147913 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-00096043-c48a-43ac-afeb-b1097ea5c5ae tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1564 microversion: 2.1 time: 0.211318 May 10 17:48:03.158157 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 227/455] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:02 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1564 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:03.176034 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-0f479ced-96cf-4229-aa34-aacd83fb4436 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:03.177716 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-0f479ced-96cf-4229-aa34-aacd83fb4436 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:03.185321 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0f479ced-96cf-4229-aa34-aacd83fb4436 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:03.185781 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0f479ced-96cf-4229-aa34-aacd83fb4436 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:03.186563 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0f479ced-96cf-4229-aa34-aacd83fb4436 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:03.187198 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0f479ced-96cf-4229-aa34-aacd83fb4436 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:03.266206 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-0f479ced-96cf-4229-aa34-aacd83fb4436 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096195 May 10 17:48:03.266808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 229/456] 10.222.0.60 () {58 vars in 1274 bytes} [Tue May 10 17:48:03 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:48:04.914850 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-72ca3c63-dc91-4b5c-88ee-cdf20bac00b3 req-c82d271b-a3f7-4bed-bd74-06b12193cca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4553a66-9c17-4820-a5ab-1e3f45b42cb2", "tag": "d41cfb7a-6772-4a26-bd70-17d9a9faa38c"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:48:04.923128 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-72ca3c63-dc91-4b5c-88ee-cdf20bac00b3 req-c82d271b-a3f7-4bed-bd74-06b12193cca0 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:04.923613 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-72ca3c63-dc91-4b5c-88ee-cdf20bac00b3 req-c82d271b-a3f7-4bed-bd74-06b12193cca0 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:04.935930 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-72ca3c63-dc91-4b5c-88ee-cdf20bac00b3 req-c82d271b-a3f7-4bed-bd74-06b12193cca0 service nova] Creating event network-changed:d41cfb7a-6772-4a26-bd70-17d9a9faa38c for instance e4553a66-9c17-4820-a5ab-1e3f45b42cb2 on hv-cinder-84130 May 10 17:48:04.942338 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-72ca3c63-dc91-4b5c-88ee-cdf20bac00b3 req-c82d271b-a3f7-4bed-bd74-06b12193cca0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031199 May 10 17:48:04.943950 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 228/457] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:48:05.262470 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:48:05.262665 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Tue May 10 17:48:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:48:23.189328 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c093fc7c-bf77-4d29-b78e-31536da99335 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Action: 'create', calling method: .version_select at 0x7f3e769badc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1064246823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIlj2mt7LXpuZmOq/fhpayKwqD2Da1Qgsx/6st0DAZUAUkGc2ts3NaB8FS2TKoLor2GqPpOQqZuTcAiQpQJt+Tha7KmBt8HHTHzhg9KnpfPXRBf+IvHF9/J51QnxHJvscA=="}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:48:23.203477 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-c093fc7c-bf77-4d29-b78e-31536da99335 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Getting quotas for project f582fd9ef9094e8f9b47f7e686e3808a. Resources: {'key_pairs'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:48:23.207168 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-c093fc7c-bf77-4d29-b78e-31536da99335 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Getting quotas for user 1b437da424eb4eb2b36382912fc3e366 and project f582fd9ef9094e8f9b47f7e686e3808a. Resources: {'key_pairs'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:48:23.233040 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c093fc7c-bf77-4d29-b78e-31536da99335 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047955 May 10 17:48:23.233727 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 230/458] 10.222.0.60 () {60 vars in 1158 bytes} [Tue May 10 17:48:23 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:48:23.287680 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e4de84fe-0489-4f8b-bd0a-98a05dae1bb7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1069143311", "imageRef": "9e0f8b23-37ae-4b9b-b07d-53cc71c42ba9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1064246823", "networks": [{"uuid": "d36cf6d1-7902-4b07-ab50-617b34c8483f"}]}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:48:23.341452 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-e4de84fe-0489-4f8b-bd0a-98a05dae1bb7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] validate_networks() for [('d36cf6d1-7902-4b07-ab50-617b34c8483f', None, None, None, None, None)] {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:48:23.720501 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-e4de84fe-0489-4f8b-bd0a-98a05dae1bb7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:48:23.720933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-e4de84fe-0489-4f8b-bd0a-98a05dae1bb7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:48:23.721415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-e4de84fe-0489-4f8b-bd0a-98a05dae1bb7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:48:23.721828 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-e4de84fe-0489-4f8b-bd0a-98a05dae1bb7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:48:23.722255 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-e4de84fe-0489-4f8b-bd0a-98a05dae1bb7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:48:23.731397 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e4de84fe-0489-4f8b-bd0a-98a05dae1bb7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:23.731857 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e4de84fe-0489-4f8b-bd0a-98a05dae1bb7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:23.732660 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e4de84fe-0489-4f8b-bd0a-98a05dae1bb7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:23.733098 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e4de84fe-0489-4f8b-bd0a-98a05dae1bb7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:23.750357 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-e4de84fe-0489-4f8b-bd0a-98a05dae1bb7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Getting quotas for project f582fd9ef9094e8f9b47f7e686e3808a. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:48:23.754422 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-e4de84fe-0489-4f8b-bd0a-98a05dae1bb7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Getting quotas for user 1b437da424eb4eb2b36382912fc3e366 and project f582fd9ef9094e8f9b47f7e686e3808a. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:48:23.765379 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e4de84fe-0489-4f8b-bd0a-98a05dae1bb7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:48:23.767866 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e4de84fe-0489-4f8b-bd0a-98a05dae1bb7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9e0f8b23-37ae-4b9b-b07d-53cc71c42ba9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:48:23.816879 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e4de84fe-0489-4f8b-bd0a-98a05dae1bb7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533958 May 10 17:48:23.817534 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 229/459] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 17:48:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:48:23.827809 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-3ce823a3-f4f2-4cfe-85e7-2b732c704cf5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:23.828483 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-3ce823a3-f4f2-4cfe-85e7-2b732c704cf5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:23.886610 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-3ce823a3-f4f2-4cfe-85e7-2b732c704cf5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:23.893949 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-3ce823a3-f4f2-4cfe-85e7-2b732c704cf5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1259 microversion: 2.1 time: 0.069942 May 10 17:48:23.894528 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 231/460] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:23 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:24.910468 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-21ac4176-47a0-461a-b0dc-d8131c67c9dd tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:24.911069 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-21ac4176-47a0-461a-b0dc-d8131c67c9dd tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:24.919516 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-21ac4176-47a0-461a-b0dc-d8131c67c9dd tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:24.919969 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-21ac4176-47a0-461a-b0dc-d8131c67c9dd tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:24.921020 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-21ac4176-47a0-461a-b0dc-d8131c67c9dd tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:24.921453 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-21ac4176-47a0-461a-b0dc-d8131c67c9dd tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:24.996826 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-21ac4176-47a0-461a-b0dc-d8131c67c9dd tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:25.004414 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-21ac4176-47a0-461a-b0dc-d8131c67c9dd tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1329 microversion: 2.1 time: 0.098044 May 10 17:48:25.004979 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 230/461] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:24 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1329 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:25.635765 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-6bcc9a33-355f-4da9-8f62-5f11ff637325 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:25.636662 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-6bcc9a33-355f-4da9-8f62-5f11ff637325 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:25.644218 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6bcc9a33-355f-4da9-8f62-5f11ff637325 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:25.644961 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6bcc9a33-355f-4da9-8f62-5f11ff637325 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:25.646242 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6bcc9a33-355f-4da9-8f62-5f11ff637325 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:25.646784 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6bcc9a33-355f-4da9-8f62-5f11ff637325 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:25.824305 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.objects.instance [None req-6bcc9a33-355f-4da9-8f62-5f11ff637325 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lazy-loading 'services' on Instance uuid 858afd1f-cdd5-4c30-b255-155c40b54fb0 {{(pid=123753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:48:25.957372 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-6bcc9a33-355f-4da9-8f62-5f11ff637325 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "DELETE /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0/os-volume_attachments/89b723b4-259f-4605-a128-486d6e7e2253" status: 202 len: 0 microversion: 2.1 time: 0.326197 May 10 17:48:25.957970 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 232/462] 10.222.0.60 () {58 vars in 1415 bytes} [Tue May 10 17:48:25 2022] DELETE /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0/os-volume_attachments/89b723b4-259f-4605-a128-486d6e7e2253 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:48:26.021175 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1ce87170-e928-4a65-84e5-10a4e8907cb0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:26.021712 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1ce87170-e928-4a65-84e5-10a4e8907cb0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:26.028443 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1ce87170-e928-4a65-84e5-10a4e8907cb0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:26.028898 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1ce87170-e928-4a65-84e5-10a4e8907cb0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:26.029675 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1ce87170-e928-4a65-84e5-10a4e8907cb0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:26.030111 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1ce87170-e928-4a65-84e5-10a4e8907cb0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:26.170456 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1ce87170-e928-4a65-84e5-10a4e8907cb0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:26.178293 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1ce87170-e928-4a65-84e5-10a4e8907cb0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.160855 May 10 17:48:26.178867 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 231/463] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:26 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:27.199554 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-87167795-4a7f-4e80-9854-9e534a688cf5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:27.200264 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-87167795-4a7f-4e80-9854-9e534a688cf5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:27.206757 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-87167795-4a7f-4e80-9854-9e534a688cf5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:27.207209 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-87167795-4a7f-4e80-9854-9e534a688cf5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:27.208039 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-87167795-4a7f-4e80-9854-9e534a688cf5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:27.208475 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-87167795-4a7f-4e80-9854-9e534a688cf5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:27.362352 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-87167795-4a7f-4e80-9854-9e534a688cf5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:27.370293 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-87167795-4a7f-4e80-9854-9e534a688cf5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.177572 May 10 17:48:27.371014 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 233/464] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:27 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:28.393753 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-25977a95-2057-4abe-b682-f7fd6f91d492 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:28.394603 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-25977a95-2057-4abe-b682-f7fd6f91d492 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:28.400767 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-25977a95-2057-4abe-b682-f7fd6f91d492 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:28.401219 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-25977a95-2057-4abe-b682-f7fd6f91d492 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:28.401997 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-25977a95-2057-4abe-b682-f7fd6f91d492 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:28.402436 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-25977a95-2057-4abe-b682-f7fd6f91d492 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:28.533925 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-25977a95-2057-4abe-b682-f7fd6f91d492 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:28.541827 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-25977a95-2057-4abe-b682-f7fd6f91d492 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.152130 May 10 17:48:28.542804 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 232/465] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:28 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:29.559051 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-55b59fe3-f3aa-4bd0-95d4-9d303c8aa666 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:29.559790 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-55b59fe3-f3aa-4bd0-95d4-9d303c8aa666 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:29.567319 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-55b59fe3-f3aa-4bd0-95d4-9d303c8aa666 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:29.567819 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-55b59fe3-f3aa-4bd0-95d4-9d303c8aa666 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:29.568559 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-55b59fe3-f3aa-4bd0-95d4-9d303c8aa666 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:29.568996 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-55b59fe3-f3aa-4bd0-95d4-9d303c8aa666 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:29.711181 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-55b59fe3-f3aa-4bd0-95d4-9d303c8aa666 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:29.718718 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-55b59fe3-f3aa-4bd0-95d4-9d303c8aa666 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.163678 May 10 17:48:29.719294 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 234/466] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:29 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:30.736133 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e061f94b-18e9-457c-8377-2dc0ec15182c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:30.736769 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e061f94b-18e9-457c-8377-2dc0ec15182c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:30.743596 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e061f94b-18e9-457c-8377-2dc0ec15182c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:30.744155 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e061f94b-18e9-457c-8377-2dc0ec15182c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:30.745249 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e061f94b-18e9-457c-8377-2dc0ec15182c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:30.745830 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e061f94b-18e9-457c-8377-2dc0ec15182c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:30.901577 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e061f94b-18e9-457c-8377-2dc0ec15182c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:30.909540 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e061f94b-18e9-457c-8377-2dc0ec15182c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.177386 May 10 17:48:30.910428 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 233/467] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:30 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:31.927047 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a4e86d3a-4918-4f78-ade8-8fc89ce2b2b9 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:31.927800 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a4e86d3a-4918-4f78-ade8-8fc89ce2b2b9 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:31.936816 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a4e86d3a-4918-4f78-ade8-8fc89ce2b2b9 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:31.937271 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a4e86d3a-4918-4f78-ade8-8fc89ce2b2b9 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:31.938052 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a4e86d3a-4918-4f78-ade8-8fc89ce2b2b9 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:31.938488 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a4e86d3a-4918-4f78-ade8-8fc89ce2b2b9 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:32.088355 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a4e86d3a-4918-4f78-ade8-8fc89ce2b2b9 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:32.099065 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a4e86d3a-4918-4f78-ade8-8fc89ce2b2b9 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.175749 May 10 17:48:32.104892 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 235/468] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:31 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:33.117231 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-080a9bc1-fc90-4bf4-9c9c-91242f6cc7be tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:33.117858 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-080a9bc1-fc90-4bf4-9c9c-91242f6cc7be tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:33.126075 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-080a9bc1-fc90-4bf4-9c9c-91242f6cc7be tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:33.126870 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-080a9bc1-fc90-4bf4-9c9c-91242f6cc7be tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:33.127942 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-080a9bc1-fc90-4bf4-9c9c-91242f6cc7be tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:33.128774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-080a9bc1-fc90-4bf4-9c9c-91242f6cc7be tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:33.506113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-080a9bc1-fc90-4bf4-9c9c-91242f6cc7be tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:33.514440 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-080a9bc1-fc90-4bf4-9c9c-91242f6cc7be tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.401075 May 10 17:48:33.515022 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 234/469] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:33 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:34.532922 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-24bb613a-643f-4472-8c79-ff5411e30f86 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:34.536501 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-24bb613a-643f-4472-8c79-ff5411e30f86 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:34.545714 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-24bb613a-643f-4472-8c79-ff5411e30f86 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:34.546630 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-24bb613a-643f-4472-8c79-ff5411e30f86 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:34.547983 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-24bb613a-643f-4472-8c79-ff5411e30f86 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:34.548853 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-24bb613a-643f-4472-8c79-ff5411e30f86 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:34.716815 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-24bb613a-643f-4472-8c79-ff5411e30f86 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:34.724462 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-24bb613a-643f-4472-8c79-ff5411e30f86 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.197143 May 10 17:48:34.725168 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 236/470] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:34 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:35.744632 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6af16791-f67c-42b8-8a65-bf57381688cc tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:35.745469 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6af16791-f67c-42b8-8a65-bf57381688cc tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:35.755116 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6af16791-f67c-42b8-8a65-bf57381688cc tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:35.755660 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6af16791-f67c-42b8-8a65-bf57381688cc tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:35.756884 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6af16791-f67c-42b8-8a65-bf57381688cc tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:35.757498 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6af16791-f67c-42b8-8a65-bf57381688cc tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:35.935077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6af16791-f67c-42b8-8a65-bf57381688cc tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:35.942804 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6af16791-f67c-42b8-8a65-bf57381688cc tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.203142 May 10 17:48:35.943417 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 235/471] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:35 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:36.959487 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-932ac941-3521-41bd-8c7c-d7930a8acc69 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:36.960207 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-932ac941-3521-41bd-8c7c-d7930a8acc69 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:36.967387 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-932ac941-3521-41bd-8c7c-d7930a8acc69 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:36.968014 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-932ac941-3521-41bd-8c7c-d7930a8acc69 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:36.968634 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-932ac941-3521-41bd-8c7c-d7930a8acc69 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:36.969080 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-932ac941-3521-41bd-8c7c-d7930a8acc69 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:37.110173 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-932ac941-3521-41bd-8c7c-d7930a8acc69 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:37.119519 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-932ac941-3521-41bd-8c7c-d7930a8acc69 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.163123 May 10 17:48:37.119519 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 237/472] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:36 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:37.156304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0119b4cb-fdf2-40f9-9888-b9e73c6de62b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:37.156943 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0119b4cb-fdf2-40f9-9888-b9e73c6de62b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:37.163843 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0119b4cb-fdf2-40f9-9888-b9e73c6de62b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:37.164327 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0119b4cb-fdf2-40f9-9888-b9e73c6de62b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:37.165728 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0119b4cb-fdf2-40f9-9888-b9e73c6de62b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:37.166339 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0119b4cb-fdf2-40f9-9888-b9e73c6de62b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:37.192630 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0119b4cb-fdf2-40f9-9888-b9e73c6de62b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/ips" status: 200 len: 152 microversion: 2.20 time: 0.040726 May 10 17:48:37.193219 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 236/473] 10.222.0.60 () {60 vars in 1288 bytes} [Tue May 10 17:48:37 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:48:38.136682 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-645bc7c0-80f6-4366-87d1-c417b7beaf91 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:38.137281 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-645bc7c0-80f6-4366-87d1-c417b7beaf91 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:38.143704 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-645bc7c0-80f6-4366-87d1-c417b7beaf91 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:38.144166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-645bc7c0-80f6-4366-87d1-c417b7beaf91 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:38.144939 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-645bc7c0-80f6-4366-87d1-c417b7beaf91 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:38.145374 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-645bc7c0-80f6-4366-87d1-c417b7beaf91 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:38.282444 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-645bc7c0-80f6-4366-87d1-c417b7beaf91 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:38.290401 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-645bc7c0-80f6-4366-87d1-c417b7beaf91 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.157200 May 10 17:48:38.291187 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 238/474] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:38 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:39.308381 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3ee3c087-d11c-459f-be42-a6c9c0c360e6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:39.309020 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3ee3c087-d11c-459f-be42-a6c9c0c360e6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:39.315816 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3ee3c087-d11c-459f-be42-a6c9c0c360e6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:39.316268 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3ee3c087-d11c-459f-be42-a6c9c0c360e6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:39.317061 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3ee3c087-d11c-459f-be42-a6c9c0c360e6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:39.317501 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3ee3c087-d11c-459f-be42-a6c9c0c360e6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:39.462035 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3ee3c087-d11c-459f-be42-a6c9c0c360e6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:39.469595 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3ee3c087-d11c-459f-be42-a6c9c0c360e6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.165830 May 10 17:48:39.470162 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 237/475] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:39 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:40.487218 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4d6a66e7-1fd2-4020-a0f0-965497d7aab4 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:40.487856 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4d6a66e7-1fd2-4020-a0f0-965497d7aab4 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:40.494364 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4d6a66e7-1fd2-4020-a0f0-965497d7aab4 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:40.494811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4d6a66e7-1fd2-4020-a0f0-965497d7aab4 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:40.495608 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4d6a66e7-1fd2-4020-a0f0-965497d7aab4 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:40.496039 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4d6a66e7-1fd2-4020-a0f0-965497d7aab4 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:40.625098 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4d6a66e7-1fd2-4020-a0f0-965497d7aab4 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:40.638429 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4d6a66e7-1fd2-4020-a0f0-965497d7aab4 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.155189 May 10 17:48:40.639785 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 239/476] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:40 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:40.675132 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-85a6dbe7-fa87-4e85-ac04-e5c90e61db6d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:48:40.675705 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-85a6dbe7-fa87-4e85-ac04-e5c90e61db6d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:40.682576 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-85a6dbe7-fa87-4e85-ac04-e5c90e61db6d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:40.683035 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-85a6dbe7-fa87-4e85-ac04-e5c90e61db6d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:40.683854 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-85a6dbe7-fa87-4e85-ac04-e5c90e61db6d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:40.684299 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-85a6dbe7-fa87-4e85-ac04-e5c90e61db6d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:40.713953 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-85a6dbe7-fa87-4e85-ac04-e5c90e61db6d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lazy-loading 'flavor' on Instance uuid 4006eed6-2338-46b7-9133-e5c3fdead35c {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:48:41.032417 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-85a6dbe7-fa87-4e85-ac04-e5c90e61db6d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "POST /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/action" status: 202 len: 0 microversion: 2.20 time: 0.361068 May 10 17:48:41.036275 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 238/477] 10.222.0.60 () {62 vars in 1318 bytes} [Tue May 10 17:48:40 2022] POST /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 17:48:41.043181 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-01c32f31-f739-4ff8-95ae-bc759e6840b8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:41.044440 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-01c32f31-f739-4ff8-95ae-bc759e6840b8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:41.050271 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-01c32f31-f739-4ff8-95ae-bc759e6840b8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:41.050744 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-01c32f31-f739-4ff8-95ae-bc759e6840b8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:41.051781 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-01c32f31-f739-4ff8-95ae-bc759e6840b8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:41.059288 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-01c32f31-f739-4ff8-95ae-bc759e6840b8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:41.216449 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-01c32f31-f739-4ff8-95ae-bc759e6840b8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:41.231934 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-01c32f31-f739-4ff8-95ae-bc759e6840b8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:41.234246 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-01c32f31-f739-4ff8-95ae-bc759e6840b8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:41.235971 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-01c32f31-f739-4ff8-95ae-bc759e6840b8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.198139 May 10 17:48:41.241571 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 240/478] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:48:41 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:48:41.322760 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-54d20277-dedd-4915-8633-85885edadc62 req-1573894e-7caa-47b5-ba5c-95675d4d2373 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab1a9bd-b249-4f09-9264-87eb2a4878cb", "tag": "f023603c-ec90-40f8-beef-59e8c9f7f17f"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:48:41.331790 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-54d20277-dedd-4915-8633-85885edadc62 req-1573894e-7caa-47b5-ba5c-95675d4d2373 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:41.332042 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-54d20277-dedd-4915-8633-85885edadc62 req-1573894e-7caa-47b5-ba5c-95675d4d2373 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:41.347079 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-54d20277-dedd-4915-8633-85885edadc62 req-1573894e-7caa-47b5-ba5c-95675d4d2373 service nova] Creating event network-changed:f023603c-ec90-40f8-beef-59e8c9f7f17f for instance 4ab1a9bd-b249-4f09-9264-87eb2a4878cb on hv-cinder-84130 May 10 17:48:41.351783 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-54d20277-dedd-4915-8633-85885edadc62 req-1573894e-7caa-47b5-ba5c-95675d4d2373 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034466 May 10 17:48:41.353160 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 239/479] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:48:41.661728 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-08302b73-fe10-43b3-9cf0-b2f24f6e361c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:41.663738 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-08302b73-fe10-43b3-9cf0-b2f24f6e361c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:41.675594 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-08302b73-fe10-43b3-9cf0-b2f24f6e361c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:41.676407 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-08302b73-fe10-43b3-9cf0-b2f24f6e361c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:41.677802 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-08302b73-fe10-43b3-9cf0-b2f24f6e361c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:41.678575 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-08302b73-fe10-43b3-9cf0-b2f24f6e361c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:41.919929 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-08302b73-fe10-43b3-9cf0-b2f24f6e361c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:41.927171 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-08302b73-fe10-43b3-9cf0-b2f24f6e361c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.274296 May 10 17:48:41.927851 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 241/480] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:41 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:42.257276 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f72071d3-7603-4296-ac73-e2bbad12469d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:42.257976 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f72071d3-7603-4296-ac73-e2bbad12469d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:42.264870 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f72071d3-7603-4296-ac73-e2bbad12469d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:42.265328 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f72071d3-7603-4296-ac73-e2bbad12469d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:42.266129 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f72071d3-7603-4296-ac73-e2bbad12469d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:42.266575 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f72071d3-7603-4296-ac73-e2bbad12469d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:42.403626 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f72071d3-7603-4296-ac73-e2bbad12469d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:42.413855 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f72071d3-7603-4296-ac73-e2bbad12469d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:42.416027 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f72071d3-7603-4296-ac73-e2bbad12469d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:42.417212 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f72071d3-7603-4296-ac73-e2bbad12469d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.164692 May 10 17:48:42.417772 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 240/481] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:48:42 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:48:42.944883 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-378e426f-d644-44ee-a0ef-9e445e313500 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:42.945502 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-378e426f-d644-44ee-a0ef-9e445e313500 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:42.952376 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-378e426f-d644-44ee-a0ef-9e445e313500 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:42.952832 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-378e426f-d644-44ee-a0ef-9e445e313500 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:42.953605 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-378e426f-d644-44ee-a0ef-9e445e313500 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:42.954050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-378e426f-d644-44ee-a0ef-9e445e313500 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:43.017204 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c366a269-c316-4ad3-8c72-4374f8e42e11 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:43.017695 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c366a269-c316-4ad3-8c72-4374f8e42e11 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:43.023580 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c366a269-c316-4ad3-8c72-4374f8e42e11 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:43.024566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c366a269-c316-4ad3-8c72-4374f8e42e11 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:43.025340 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c366a269-c316-4ad3-8c72-4374f8e42e11 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:43.025773 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c366a269-c316-4ad3-8c72-4374f8e42e11 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:43.050984 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c366a269-c316-4ad3-8c72-4374f8e42e11 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:48:43.087587 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-378e426f-d644-44ee-a0ef-9e445e313500 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:43.095786 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-378e426f-d644-44ee-a0ef-9e445e313500 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.154588 May 10 17:48:43.096294 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 242/482] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:42 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:43.132578 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c366a269-c316-4ad3-8c72-4374f8e42e11 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "DELETE /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 204 len: 0 microversion: 2.1 time: 0.118971 May 10 17:48:43.133169 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 241/483] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:48:43 2022] DELETE /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 17:48:43.141365 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2ff45fc1-72a4-4ef7-bfb0-9b8dc4917372 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:43.142006 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-2ff45fc1-72a4-4ef7-bfb0-9b8dc4917372 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:43.148162 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2ff45fc1-72a4-4ef7-bfb0-9b8dc4917372 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:43.148620 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2ff45fc1-72a4-4ef7-bfb0-9b8dc4917372 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:43.150022 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2ff45fc1-72a4-4ef7-bfb0-9b8dc4917372 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:43.150692 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2ff45fc1-72a4-4ef7-bfb0-9b8dc4917372 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:43.295811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-2ff45fc1-72a4-4ef7-bfb0-9b8dc4917372 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:43.303353 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-2ff45fc1-72a4-4ef7-bfb0-9b8dc4917372 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1514 microversion: 2.1 time: 0.165754 May 10 17:48:43.303962 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 243/484] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:43 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:43.436236 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1557d1c4-7338-4993-86f9-4367b5e4e09b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:43.437060 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1557d1c4-7338-4993-86f9-4367b5e4e09b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:43.443292 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1557d1c4-7338-4993-86f9-4367b5e4e09b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:43.443788 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1557d1c4-7338-4993-86f9-4367b5e4e09b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:43.444565 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1557d1c4-7338-4993-86f9-4367b5e4e09b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:43.445076 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1557d1c4-7338-4993-86f9-4367b5e4e09b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:43.581748 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1557d1c4-7338-4993-86f9-4367b5e4e09b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:43.591243 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1557d1c4-7338-4993-86f9-4367b5e4e09b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:43.592778 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1557d1c4-7338-4993-86f9-4367b5e4e09b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:43.593961 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1557d1c4-7338-4993-86f9-4367b5e4e09b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.162478 May 10 17:48:43.594530 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 242/485] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:48:43 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:48:43.859863 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f4569a2a-8533-4989-a903-513048d7ecf4 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:43.860360 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f4569a2a-8533-4989-a903-513048d7ecf4 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:43.866382 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f4569a2a-8533-4989-a903-513048d7ecf4 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:43.866827 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f4569a2a-8533-4989-a903-513048d7ecf4 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:43.867782 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f4569a2a-8533-4989-a903-513048d7ecf4 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:43.868223 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f4569a2a-8533-4989-a903-513048d7ecf4 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:43.891537 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f4569a2a-8533-4989-a903-513048d7ecf4 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1/ips" status: 200 len: 151 microversion: 2.1 time: 0.035548 May 10 17:48:43.892106 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 244/486] 10.222.0.60 () {58 vars in 1247 bytes} [Tue May 10 17:48:43 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:48:44.113098 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9904c1e8-8331-4176-9dc2-9cb448fd4e82 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:44.113730 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9904c1e8-8331-4176-9dc2-9cb448fd4e82 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:44.121676 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9904c1e8-8331-4176-9dc2-9cb448fd4e82 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:44.122166 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9904c1e8-8331-4176-9dc2-9cb448fd4e82 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:44.123168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9904c1e8-8331-4176-9dc2-9cb448fd4e82 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:44.123597 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9904c1e8-8331-4176-9dc2-9cb448fd4e82 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:44.280170 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9904c1e8-8331-4176-9dc2-9cb448fd4e82 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:44.293305 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9904c1e8-8331-4176-9dc2-9cb448fd4e82 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.183748 May 10 17:48:44.294256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 243/487] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:44 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:44.323212 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b9f277e4-7955-4f38-b112-bc6e35ecfbc0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:44.323890 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-b9f277e4-7955-4f38-b112-bc6e35ecfbc0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:44.330750 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b9f277e4-7955-4f38-b112-bc6e35ecfbc0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:44.331183 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b9f277e4-7955-4f38-b112-bc6e35ecfbc0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:44.332020 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b9f277e4-7955-4f38-b112-bc6e35ecfbc0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:44.332466 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b9f277e4-7955-4f38-b112-bc6e35ecfbc0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:44.474775 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b9f277e4-7955-4f38-b112-bc6e35ecfbc0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:44.482983 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b9f277e4-7955-4f38-b112-bc6e35ecfbc0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1514 microversion: 2.1 time: 0.164701 May 10 17:48:44.483589 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 245/488] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:44 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:44.613070 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b1a53802-4fc2-4485-a9e6-8cf6657abf52 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:44.613794 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b1a53802-4fc2-4485-a9e6-8cf6657abf52 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:44.620693 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b1a53802-4fc2-4485-a9e6-8cf6657abf52 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:44.621141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b1a53802-4fc2-4485-a9e6-8cf6657abf52 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:44.621914 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b1a53802-4fc2-4485-a9e6-8cf6657abf52 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:44.622353 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b1a53802-4fc2-4485-a9e6-8cf6657abf52 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:44.763738 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b1a53802-4fc2-4485-a9e6-8cf6657abf52 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:44.772260 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b1a53802-4fc2-4485-a9e6-8cf6657abf52 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:44.773779 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b1a53802-4fc2-4485-a9e6-8cf6657abf52 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:44.775921 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b1a53802-4fc2-4485-a9e6-8cf6657abf52 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.166726 May 10 17:48:44.776510 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 244/489] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:48:44 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:48:45.317803 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7969e7cc-6f90-4190-bdc6-e7bcf534bcb6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:45.325596 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7969e7cc-6f90-4190-bdc6-e7bcf534bcb6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:45.325596 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7969e7cc-6f90-4190-bdc6-e7bcf534bcb6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:45.327065 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7969e7cc-6f90-4190-bdc6-e7bcf534bcb6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:45.327065 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7969e7cc-6f90-4190-bdc6-e7bcf534bcb6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:45.327239 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7969e7cc-6f90-4190-bdc6-e7bcf534bcb6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:45.500884 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6808c639-f696-4ae9-a0be-bb5b54e1f81b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:45.501490 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6808c639-f696-4ae9-a0be-bb5b54e1f81b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:45.507324 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6808c639-f696-4ae9-a0be-bb5b54e1f81b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:45.507885 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6808c639-f696-4ae9-a0be-bb5b54e1f81b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:45.509232 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6808c639-f696-4ae9-a0be-bb5b54e1f81b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:45.509710 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6808c639-f696-4ae9-a0be-bb5b54e1f81b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:45.521941 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7969e7cc-6f90-4190-bdc6-e7bcf534bcb6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:45.530410 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7969e7cc-6f90-4190-bdc6-e7bcf534bcb6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.216442 May 10 17:48:45.531449 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 246/490] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:45 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:45.658043 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6808c639-f696-4ae9-a0be-bb5b54e1f81b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:45.665844 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6808c639-f696-4ae9-a0be-bb5b54e1f81b tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1514 microversion: 2.1 time: 0.169348 May 10 17:48:45.666425 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 245/491] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:45 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:48:45.795392 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-64ce302f-607e-4ff0-84b5-020e21b982c1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:45.795942 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-64ce302f-607e-4ff0-84b5-020e21b982c1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:45.802100 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-64ce302f-607e-4ff0-84b5-020e21b982c1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:45.802562 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-64ce302f-607e-4ff0-84b5-020e21b982c1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:45.803342 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-64ce302f-607e-4ff0-84b5-020e21b982c1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:45.803805 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-64ce302f-607e-4ff0-84b5-020e21b982c1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:45.950412 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-64ce302f-607e-4ff0-84b5-020e21b982c1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:45.958507 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-64ce302f-607e-4ff0-84b5-020e21b982c1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:45.960098 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-64ce302f-607e-4ff0-84b5-020e21b982c1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:45.961255 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-64ce302f-607e-4ff0-84b5-020e21b982c1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.169969 May 10 17:48:45.961900 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 247/492] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:48:45 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:48:46.317212 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f481c587-f10c-46b3-9240-089a452e1467 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c70fbf62-000c-4eb9-9ac1-ecaac34cf13b"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:48:46.318384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f481c587-f10c-46b3-9240-089a452e1467 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:46.325165 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f481c587-f10c-46b3-9240-089a452e1467 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:46.325615 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f481c587-f10c-46b3-9240-089a452e1467 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:46.326399 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f481c587-f10c-46b3-9240-089a452e1467 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:46.326857 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f481c587-f10c-46b3-9240-089a452e1467 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:46.548210 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-30512ee3-7dae-44f1-907e-0ffab6d60086 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:46.548832 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-30512ee3-7dae-44f1-907e-0ffab6d60086 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:46.555584 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-30512ee3-7dae-44f1-907e-0ffab6d60086 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:46.556046 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-30512ee3-7dae-44f1-907e-0ffab6d60086 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:46.556852 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-30512ee3-7dae-44f1-907e-0ffab6d60086 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:46.557282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-30512ee3-7dae-44f1-907e-0ffab6d60086 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:46.702529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-30512ee3-7dae-44f1-907e-0ffab6d60086 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:46.712537 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-30512ee3-7dae-44f1-907e-0ffab6d60086 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.168134 May 10 17:48:46.713112 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 248/493] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:46 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:48:46.720105 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-920b75d5-16c7-4345-8308-4c2365898802 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:46.721248 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-920b75d5-16c7-4345-8308-4c2365898802 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:46.730844 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-920b75d5-16c7-4345-8308-4c2365898802 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:46.731640 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-920b75d5-16c7-4345-8308-4c2365898802 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:46.732915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-920b75d5-16c7-4345-8308-4c2365898802 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:46.733641 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-920b75d5-16c7-4345-8308-4c2365898802 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:46.883072 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-920b75d5-16c7-4345-8308-4c2365898802 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:46.891568 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-920b75d5-16c7-4345-8308-4c2365898802 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1514 microversion: 2.1 time: 0.177408 May 10 17:48:46.892142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 249/494] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:46 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:46.979989 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-486a460c-8ddb-4244-a0a4-3970e5739070 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:46.980891 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-486a460c-8ddb-4244-a0a4-3970e5739070 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:46.986710 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-486a460c-8ddb-4244-a0a4-3970e5739070 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:46.987338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-486a460c-8ddb-4244-a0a4-3970e5739070 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:46.987959 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-486a460c-8ddb-4244-a0a4-3970e5739070 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:46.988396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-486a460c-8ddb-4244-a0a4-3970e5739070 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:47.135344 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-486a460c-8ddb-4244-a0a4-3970e5739070 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:47.143995 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-486a460c-8ddb-4244-a0a4-3970e5739070 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:47.145495 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-486a460c-8ddb-4244-a0a4-3970e5739070 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:47.146711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-486a460c-8ddb-4244-a0a4-3970e5739070 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.171134 May 10 17:48:47.147277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 250/495] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:48:46 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:48:47.439592 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f481c587-f10c-46b3-9240-089a452e1467 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "POST /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.126341 May 10 17:48:47.440348 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 246/496] 10.222.0.60 () {60 vars in 1322 bytes} [Tue May 10 17:48:46 2022] POST /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1/os-volume_attachments => generated 194 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:48:47.730041 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-6442f801-772a-4545-bc78-3062598a9661 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:47.730650 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-6442f801-772a-4545-bc78-3062598a9661 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:47.736969 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6442f801-772a-4545-bc78-3062598a9661 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:47.737415 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6442f801-772a-4545-bc78-3062598a9661 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:47.738176 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6442f801-772a-4545-bc78-3062598a9661 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:47.738604 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6442f801-772a-4545-bc78-3062598a9661 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:47.873485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6442f801-772a-4545-bc78-3062598a9661 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:47.881198 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-6442f801-772a-4545-bc78-3062598a9661 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.155700 May 10 17:48:47.881772 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 251/497] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:47 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:47.910196 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-69fc0db1-6cd7-47c8-aca5-c84cc8fdc89d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:47.910896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-69fc0db1-6cd7-47c8-aca5-c84cc8fdc89d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:47.917939 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-69fc0db1-6cd7-47c8-aca5-c84cc8fdc89d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:47.918400 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-69fc0db1-6cd7-47c8-aca5-c84cc8fdc89d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:47.919194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-69fc0db1-6cd7-47c8-aca5-c84cc8fdc89d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:47.919668 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-69fc0db1-6cd7-47c8-aca5-c84cc8fdc89d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:48.056133 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-69fc0db1-6cd7-47c8-aca5-c84cc8fdc89d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:48.063882 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-69fc0db1-6cd7-47c8-aca5-c84cc8fdc89d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1514 microversion: 2.1 time: 0.158329 May 10 17:48:48.064471 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 247/498] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:47 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:48.165000 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ebb13b9d-f3e7-412e-8468-162185f9a340 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:48.165531 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ebb13b9d-f3e7-412e-8468-162185f9a340 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:48.171546 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ebb13b9d-f3e7-412e-8468-162185f9a340 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:48.171994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ebb13b9d-f3e7-412e-8468-162185f9a340 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:48.172752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ebb13b9d-f3e7-412e-8468-162185f9a340 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:48.173184 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ebb13b9d-f3e7-412e-8468-162185f9a340 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:48.311533 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ebb13b9d-f3e7-412e-8468-162185f9a340 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:48.320408 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ebb13b9d-f3e7-412e-8468-162185f9a340 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:48.323353 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ebb13b9d-f3e7-412e-8468-162185f9a340 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:48.324563 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ebb13b9d-f3e7-412e-8468-162185f9a340 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.163644 May 10 17:48:48.325135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 252/499] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:48:48 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:48:48.593008 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-7c3f5721-0fe1-43d1-88a6-db8bca53eda4 req-c57cabfe-f9d2-4a75-86ea-f0edbf4b53c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab1a9bd-b249-4f09-9264-87eb2a4878cb", "name": "network-vif-plugged", "status": "completed", "tag": "f023603c-ec90-40f8-beef-59e8c9f7f17f"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:48:48.603987 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-7c3f5721-0fe1-43d1-88a6-db8bca53eda4 req-c57cabfe-f9d2-4a75-86ea-f0edbf4b53c3 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:48.604744 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-7c3f5721-0fe1-43d1-88a6-db8bca53eda4 req-c57cabfe-f9d2-4a75-86ea-f0edbf4b53c3 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:48.622521 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-7c3f5721-0fe1-43d1-88a6-db8bca53eda4 req-c57cabfe-f9d2-4a75-86ea-f0edbf4b53c3 service nova] Creating event network-vif-plugged:f023603c-ec90-40f8-beef-59e8c9f7f17f for instance 4ab1a9bd-b249-4f09-9264-87eb2a4878cb on hv-cinder-84130 May 10 17:48:48.630962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-7c3f5721-0fe1-43d1-88a6-db8bca53eda4 req-c57cabfe-f9d2-4a75-86ea-f0edbf4b53c3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042550 May 10 17:48:48.632048 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 248/500] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:48:48.904176 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fb598996-2e96-4d33-88d2-388e55033e6e tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:48.905369 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-fb598996-2e96-4d33-88d2-388e55033e6e tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:48.918543 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fb598996-2e96-4d33-88d2-388e55033e6e tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:48.919354 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fb598996-2e96-4d33-88d2-388e55033e6e tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:48.920825 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fb598996-2e96-4d33-88d2-388e55033e6e tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:48.921627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fb598996-2e96-4d33-88d2-388e55033e6e tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:49.078215 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-4b7364fb-73d0-4430-9e76-868d2fd001e8 req-bcac7b1e-eb81-455f-8965-2e191ce92958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "858afd1f-cdd5-4c30-b255-155c40b54fb0", "name": "network-vif-deleted", "tag": "8eeae9a2-0065-4b4b-9a97-c00de1868cf2"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:48:49.092354 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-4b7364fb-73d0-4430-9e76-868d2fd001e8 req-bcac7b1e-eb81-455f-8965-2e191ce92958 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:49.093350 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-4b7364fb-73d0-4430-9e76-868d2fd001e8 req-bcac7b1e-eb81-455f-8965-2e191ce92958 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:49.105424 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-4b7364fb-73d0-4430-9e76-868d2fd001e8 req-bcac7b1e-eb81-455f-8965-2e191ce92958 service nova] Creating event network-vif-deleted:8eeae9a2-0065-4b4b-9a97-c00de1868cf2 for instance 858afd1f-cdd5-4c30-b255-155c40b54fb0 on hv-cinder-84130 May 10 17:48:49.110393 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-4b7364fb-73d0-4430-9e76-868d2fd001e8 req-bcac7b1e-eb81-455f-8965-2e191ce92958 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046009 May 10 17:48:49.111280 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 249/501] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:48:49.117288 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-98ee1711-938d-4ff2-8fa4-1ed6cd5f52f8 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:49.118426 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-98ee1711-938d-4ff2-8fa4-1ed6cd5f52f8 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:49.126555 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98ee1711-938d-4ff2-8fa4-1ed6cd5f52f8 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:49.127020 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98ee1711-938d-4ff2-8fa4-1ed6cd5f52f8 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:49.127834 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98ee1711-938d-4ff2-8fa4-1ed6cd5f52f8 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:49.129001 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98ee1711-938d-4ff2-8fa4-1ed6cd5f52f8 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:49.131081 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fb598996-2e96-4d33-88d2-388e55033e6e tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:49.138960 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-fb598996-2e96-4d33-88d2-388e55033e6e tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.242581 May 10 17:48:49.139589 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 253/502] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:48 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:49.195687 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-98ee1711-938d-4ff2-8fa4-1ed6cd5f52f8 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:49.204143 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-98ee1711-938d-4ff2-8fa4-1ed6cd5f52f8 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 200 len: 1303 microversion: 2.1 time: 0.091393 May 10 17:48:49.204925 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 250/503] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:49 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:49.342039 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-0a0dc9f8-6678-43c9-9fa9-0f093a99da78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:49.342647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-0a0dc9f8-6678-43c9-9fa9-0f093a99da78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:49.348586 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0a0dc9f8-6678-43c9-9fa9-0f093a99da78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:49.349039 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0a0dc9f8-6678-43c9-9fa9-0f093a99da78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:49.349802 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0a0dc9f8-6678-43c9-9fa9-0f093a99da78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:49.350244 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0a0dc9f8-6678-43c9-9fa9-0f093a99da78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:49.492239 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-0a0dc9f8-6678-43c9-9fa9-0f093a99da78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:49.500755 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-0a0dc9f8-6678-43c9-9fa9-0f093a99da78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:49.502259 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-0a0dc9f8-6678-43c9-9fa9-0f093a99da78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:49.503468 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-0a0dc9f8-6678-43c9-9fa9-0f093a99da78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.165288 May 10 17:48:49.504033 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 254/504] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:48:49 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:48:50.159013 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-eb2e05fe-e107-423b-9e26-cf9b9f090ff8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:50.160106 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-eb2e05fe-e107-423b-9e26-cf9b9f090ff8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:50.173518 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-eb2e05fe-e107-423b-9e26-cf9b9f090ff8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:50.173780 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-eb2e05fe-e107-423b-9e26-cf9b9f090ff8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:50.175169 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-eb2e05fe-e107-423b-9e26-cf9b9f090ff8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:50.175992 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-eb2e05fe-e107-423b-9e26-cf9b9f090ff8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:50.221889 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-74c1ec23-0b58-4f7c-8598-22462aaa4ff1 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:50.222506 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-74c1ec23-0b58-4f7c-8598-22462aaa4ff1 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 858afd1f-cdd5-4c30-b255-155c40b54fb0] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:50.231426 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-74c1ec23-0b58-4f7c-8598-22462aaa4ff1 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:50.232225 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-74c1ec23-0b58-4f7c-8598-22462aaa4ff1 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:50.233618 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-74c1ec23-0b58-4f7c-8598-22462aaa4ff1 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:50.234374 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-74c1ec23-0b58-4f7c-8598-22462aaa4ff1 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:50.260629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-74c1ec23-0b58-4f7c-8598-22462aaa4ff1 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] HTTP exception thrown: Instance 858afd1f-cdd5-4c30-b255-155c40b54fb0 could not be found. May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-74c1ec23-0b58-4f7c-8598-22462aaa4ff1 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Request method failure captured: May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 HTTP/1.1 May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqTbQezBWYbLJ1lEvxdEF9zxM8hQmdKHGxL6OEUo6GcqFpwA06Y02t5ECEXTa8KAxKnKNW1toi6PDRCwceHG1_lcGKwsimFsSvRWjqHATidcvJrVeeKRbcBFXJvN4xete-pl1yPyVXlnZNa7zRZkQ2CJcVbkAGkQJrnq3VcBUK3PEz4 May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: 9a2c0807e3fc4161b894f123e8acc473 May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1645568956 May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:48:50.263703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:48:50.265097 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a2c0807e3fc4161b894f123e8acc473"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9a2c0807e3fc4161b894f123e8acc473"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9a2c0807e3fc4161b894f123e8acc473"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a2c0807e3fc4161b894f123e8acc473"}]}] May 10 17:48:50.265097 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-VolumesSnapshotTestJSON-1645568956 May 10 17:48:50.265097 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: 9a2c0807e3fc4161b894f123e8acc473 May 10 17:48:50.265097 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1645568956 May 10 17:48:50.265097 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-VolumesSnapshotTestJSON-1645568956-project May 10 17:48:50.265097 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:48:50.265097 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:48:50.265097 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: 37203169f06d42c59dc670dc416caf38 May 10 17:48:50.265097 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-VolumesSnapshotTestJSON-1645568956-project May 10 17:48:50.265097 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:48:50.265097 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance 858afd1f-cdd5-4c30-b255-155c40b54fb0 could not be found. May 10 17:48:50.265097 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': '858afd1f-cdd5-4c30-b255-155c40b54fb0'} May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 858afd1f-cdd5-4c30-b255-155c40b54fb0 could not be found. May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:48:50.265858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:48:50.267529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:48:50.267529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:48:50.267529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:48:50.267529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:48:50.267529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:48:50.267529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:48:50.267529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:48:50.267529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 858afd1f-cdd5-4c30-b255-155c40b54fb0 could not be found. May 10 17:48:50.267529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:48:50.267529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:48:50.267529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:48:50.267529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:48:50.267529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:48:50.267529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:48:50.267529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:48:50.267529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:48:50.267529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 858afd1f-cdd5-4c30-b255-155c40b54fb0 could not be found. May 10 17:48:50.267529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:48:50.268629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-74c1ec23-0b58-4f7c-8598-22462aaa4ff1 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Returning 404 to user: Instance 858afd1f-cdd5-4c30-b255-155c40b54fb0 could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:48:50.268629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-74c1ec23-0b58-4f7c-8598-22462aaa4ff1 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0" status: 404 len: 111 microversion: 2.1 time: 0.047439 May 10 17:48:50.268629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 255/505] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:50 2022] GET /compute/v2.1/servers/858afd1f-cdd5-4c30-b255-155c40b54fb0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 17:48:50.346343 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-eb2e05fe-e107-423b-9e26-cf9b9f090ff8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:50.353990 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-eb2e05fe-e107-423b-9e26-cf9b9f090ff8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.201853 May 10 17:48:50.354680 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 251/506] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:50 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:50.522168 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c33c2062-bb43-40c7-8ad9-3333973c02b0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:50.522777 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c33c2062-bb43-40c7-8ad9-3333973c02b0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:50.528923 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c33c2062-bb43-40c7-8ad9-3333973c02b0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:50.529374 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c33c2062-bb43-40c7-8ad9-3333973c02b0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:50.530179 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c33c2062-bb43-40c7-8ad9-3333973c02b0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:50.530612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c33c2062-bb43-40c7-8ad9-3333973c02b0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:50.678704 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c33c2062-bb43-40c7-8ad9-3333973c02b0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:50.690519 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c33c2062-bb43-40c7-8ad9-3333973c02b0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:50.692446 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c33c2062-bb43-40c7-8ad9-3333973c02b0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:50.693836 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c33c2062-bb43-40c7-8ad9-3333973c02b0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.175599 May 10 17:48:50.694602 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 256/507] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:48:50 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:48:51.371426 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a243c8e4-604c-4e9a-8d38-b36602c43fb5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:51.372053 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a243c8e4-604c-4e9a-8d38-b36602c43fb5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:51.378902 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a243c8e4-604c-4e9a-8d38-b36602c43fb5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:51.379376 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a243c8e4-604c-4e9a-8d38-b36602c43fb5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:51.380167 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a243c8e4-604c-4e9a-8d38-b36602c43fb5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:51.380609 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a243c8e4-604c-4e9a-8d38-b36602c43fb5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:51.526828 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a243c8e4-604c-4e9a-8d38-b36602c43fb5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:51.535559 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a243c8e4-604c-4e9a-8d38-b36602c43fb5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.167792 May 10 17:48:51.536115 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 252/508] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:51 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:51.714131 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4e022314-2569-4897-986a-8ce18118bb2f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:51.714735 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4e022314-2569-4897-986a-8ce18118bb2f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:51.721518 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e022314-2569-4897-986a-8ce18118bb2f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:51.721973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e022314-2569-4897-986a-8ce18118bb2f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:51.722772 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e022314-2569-4897-986a-8ce18118bb2f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:51.723220 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e022314-2569-4897-986a-8ce18118bb2f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:51.868546 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4e022314-2569-4897-986a-8ce18118bb2f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:51.876831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4e022314-2569-4897-986a-8ce18118bb2f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:51.878367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4e022314-2569-4897-986a-8ce18118bb2f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:51.879591 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4e022314-2569-4897-986a-8ce18118bb2f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.170550 May 10 17:48:51.880157 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 257/509] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:48:51 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:48:52.553010 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e5b2b7c0-f903-47d1-8010-3751757d6463 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:52.553620 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e5b2b7c0-f903-47d1-8010-3751757d6463 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:52.560593 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e5b2b7c0-f903-47d1-8010-3751757d6463 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:52.561047 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e5b2b7c0-f903-47d1-8010-3751757d6463 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:52.561821 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e5b2b7c0-f903-47d1-8010-3751757d6463 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:52.562260 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e5b2b7c0-f903-47d1-8010-3751757d6463 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:52.689079 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e5b2b7c0-f903-47d1-8010-3751757d6463 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:52.697190 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e5b2b7c0-f903-47d1-8010-3751757d6463 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.147774 May 10 17:48:52.697750 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 253/510] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:52 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:52.898664 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-df91baf1-06c7-4df2-bdf6-2cde805c3e67 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:52.899773 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-df91baf1-06c7-4df2-bdf6-2cde805c3e67 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:52.906433 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-df91baf1-06c7-4df2-bdf6-2cde805c3e67 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:52.906888 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-df91baf1-06c7-4df2-bdf6-2cde805c3e67 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:52.907713 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-df91baf1-06c7-4df2-bdf6-2cde805c3e67 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:52.908163 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-df91baf1-06c7-4df2-bdf6-2cde805c3e67 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:53.064266 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-df91baf1-06c7-4df2-bdf6-2cde805c3e67 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:53.072844 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-df91baf1-06c7-4df2-bdf6-2cde805c3e67 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:53.074337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-df91baf1-06c7-4df2-bdf6-2cde805c3e67 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:53.075522 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-df91baf1-06c7-4df2-bdf6-2cde805c3e67 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.180834 May 10 17:48:53.076088 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 258/511] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:48:52 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:48:53.714392 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3592f1de-b29a-447f-a9e9-24f1342403b6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:53.714995 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3592f1de-b29a-447f-a9e9-24f1342403b6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:53.721523 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3592f1de-b29a-447f-a9e9-24f1342403b6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:53.721973 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3592f1de-b29a-447f-a9e9-24f1342403b6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:53.722802 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3592f1de-b29a-447f-a9e9-24f1342403b6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:53.723194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3592f1de-b29a-447f-a9e9-24f1342403b6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:53.855138 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3592f1de-b29a-447f-a9e9-24f1342403b6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:53.862697 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3592f1de-b29a-447f-a9e9-24f1342403b6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.152432 May 10 17:48:53.863277 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 254/512] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:53 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:54.094249 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c48a24a3-dc89-4fb6-8708-31e07b8b470e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:54.094810 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c48a24a3-dc89-4fb6-8708-31e07b8b470e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:54.101423 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c48a24a3-dc89-4fb6-8708-31e07b8b470e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:54.101868 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c48a24a3-dc89-4fb6-8708-31e07b8b470e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:54.103309 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c48a24a3-dc89-4fb6-8708-31e07b8b470e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:54.103957 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c48a24a3-dc89-4fb6-8708-31e07b8b470e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:54.234349 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c48a24a3-dc89-4fb6-8708-31e07b8b470e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:54.242387 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c48a24a3-dc89-4fb6-8708-31e07b8b470e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:54.244396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c48a24a3-dc89-4fb6-8708-31e07b8b470e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:54.245552 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c48a24a3-dc89-4fb6-8708-31e07b8b470e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.155340 May 10 17:48:54.246113 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 259/513] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:48:54 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:48:54.880521 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2c9de9e3-3b72-400a-a105-3cd6e483ddd5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:54.881251 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2c9de9e3-3b72-400a-a105-3cd6e483ddd5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:54.888679 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2c9de9e3-3b72-400a-a105-3cd6e483ddd5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:54.889137 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2c9de9e3-3b72-400a-a105-3cd6e483ddd5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:54.889929 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2c9de9e3-3b72-400a-a105-3cd6e483ddd5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:54.893078 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2c9de9e3-3b72-400a-a105-3cd6e483ddd5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:55.024995 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2c9de9e3-3b72-400a-a105-3cd6e483ddd5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:55.032487 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2c9de9e3-3b72-400a-a105-3cd6e483ddd5 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1359 microversion: 2.1 time: 0.155909 May 10 17:48:55.033176 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 255/514] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:54 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:48:55.265003 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-3d285dfe-ed86-45fe-965a-d08dd90459c5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:55.265600 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-3d285dfe-ed86-45fe-965a-d08dd90459c5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:55.272333 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3d285dfe-ed86-45fe-965a-d08dd90459c5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:55.272778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3d285dfe-ed86-45fe-965a-d08dd90459c5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:55.273547 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3d285dfe-ed86-45fe-965a-d08dd90459c5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:55.274138 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3d285dfe-ed86-45fe-965a-d08dd90459c5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:55.406454 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-3d285dfe-ed86-45fe-965a-d08dd90459c5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:55.415205 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-3d285dfe-ed86-45fe-965a-d08dd90459c5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:55.416722 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-3d285dfe-ed86-45fe-965a-d08dd90459c5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:55.417888 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-3d285dfe-ed86-45fe-965a-d08dd90459c5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.157573 May 10 17:48:55.418448 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 260/515] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:48:55 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:48:56.050430 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ce193773-612f-4b8b-be13-f2c843bde2ea tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:56.051168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ce193773-612f-4b8b-be13-f2c843bde2ea tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:56.058542 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ce193773-612f-4b8b-be13-f2c843bde2ea tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:56.058996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ce193773-612f-4b8b-be13-f2c843bde2ea tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:56.059842 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ce193773-612f-4b8b-be13-f2c843bde2ea tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:56.060288 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ce193773-612f-4b8b-be13-f2c843bde2ea tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:56.208640 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ce193773-612f-4b8b-be13-f2c843bde2ea tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:56.217149 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ce193773-612f-4b8b-be13-f2c843bde2ea tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1548 microversion: 2.1 time: 0.170904 May 10 17:48:56.217739 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 256/516] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:56 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:56.234103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-579cc694-549e-42d7-b666-76dbff2022ac tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:56.234706 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-579cc694-549e-42d7-b666-76dbff2022ac tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:56.240724 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-579cc694-549e-42d7-b666-76dbff2022ac tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:56.241166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-579cc694-549e-42d7-b666-76dbff2022ac tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:56.241927 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-579cc694-549e-42d7-b666-76dbff2022ac tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:56.242362 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-579cc694-549e-42d7-b666-76dbff2022ac tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:56.382452 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-579cc694-549e-42d7-b666-76dbff2022ac tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:56.390929 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-579cc694-549e-42d7-b666-76dbff2022ac tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1548 microversion: 2.1 time: 0.160569 May 10 17:48:56.391541 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 261/517] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:56 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:56.407276 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bdee1cda-79f7-4165-8478-7e9786604921 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:56.410796 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-bdee1cda-79f7-4165-8478-7e9786604921 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:56.411601 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-bdee1cda-79f7-4165-8478-7e9786604921 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Searching by: {'deleted': False, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a'} {{(pid=123752) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 10 17:48:56.418488 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bdee1cda-79f7-4165-8478-7e9786604921 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:56.418944 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bdee1cda-79f7-4165-8478-7e9786604921 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:56.419781 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bdee1cda-79f7-4165-8478-7e9786604921 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:56.420225 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bdee1cda-79f7-4165-8478-7e9786604921 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:56.436630 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8022efa4-c183-423c-8eac-f090a5ff91bb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:56.437554 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8022efa4-c183-423c-8eac-f090a5ff91bb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:56.443927 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8022efa4-c183-423c-8eac-f090a5ff91bb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:56.444457 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8022efa4-c183-423c-8eac-f090a5ff91bb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:56.445299 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8022efa4-c183-423c-8eac-f090a5ff91bb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:56.447412 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8022efa4-c183-423c-8eac-f090a5ff91bb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:56.515886 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.multi_cell_list [None req-bdee1cda-79f7-4165-8478-7e9786604921 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123752) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 10 17:48:56.606811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-8022efa4-c183-423c-8eac-f090a5ff91bb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:56.623310 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-8022efa4-c183-423c-8eac-f090a5ff91bb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:56.626294 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-8022efa4-c183-423c-8eac-f090a5ff91bb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:56.628547 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8022efa4-c183-423c-8eac-f090a5ff91bb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.195564 May 10 17:48:56.628946 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bdee1cda-79f7-4165-8478-7e9786604921 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.225461 May 10 17:48:56.629796 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 257/518] 10.222.0.60 () {58 vars in 1124 bytes} [Tue May 10 17:48:56 2022] GET /compute/v2.1/servers => generated 343 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:48:56.630085 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 262/519] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:48:56 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:48:56.646118 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3b633945-a7ee-4aba-b0da-1a6b9c16b3e9 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:56.646744 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3b633945-a7ee-4aba-b0da-1a6b9c16b3e9 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:56.656178 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3b633945-a7ee-4aba-b0da-1a6b9c16b3e9 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:56.656626 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3b633945-a7ee-4aba-b0da-1a6b9c16b3e9 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:56.657416 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3b633945-a7ee-4aba-b0da-1a6b9c16b3e9 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:56.657859 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3b633945-a7ee-4aba-b0da-1a6b9c16b3e9 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:56.789818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3b633945-a7ee-4aba-b0da-1a6b9c16b3e9 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:56.797615 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3b633945-a7ee-4aba-b0da-1a6b9c16b3e9 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1548 microversion: 2.1 time: 0.155620 May 10 17:48:56.798194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 258/520] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:48:56 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:48:57.648550 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4a272ace-e61b-4f67-8841-bacb3da05bd4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:57.649166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4a272ace-e61b-4f67-8841-bacb3da05bd4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:57.656385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4a272ace-e61b-4f67-8841-bacb3da05bd4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:57.656964 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4a272ace-e61b-4f67-8841-bacb3da05bd4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:57.657820 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4a272ace-e61b-4f67-8841-bacb3da05bd4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:57.658264 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4a272ace-e61b-4f67-8841-bacb3da05bd4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:57.787917 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4a272ace-e61b-4f67-8841-bacb3da05bd4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:57.796325 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4a272ace-e61b-4f67-8841-bacb3da05bd4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:57.797823 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4a272ace-e61b-4f67-8841-bacb3da05bd4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:57.798975 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4a272ace-e61b-4f67-8841-bacb3da05bd4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.154456 May 10 17:48:57.799560 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 263/521] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:48:57 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:48:58.154235 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a9bd3751-3a10-455d-bb12-0039e8836e0d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Action: 'create', calling method: .version_select at 0x7f3e7699c040>, body: {"keypair": {"name": "tempest-keypair-1115855894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJN7qtqGPc2r6pvQK+q8VcXXDe4ofMzNcmeEunYzlPnQeescvoEJvdjRPkHcaxmQWeQk/0vEVvz0VVWDyx79xYHm32NOB9LlL9l4i33HncdAMFwI3eBm7rRbqXvmLGTCg=="}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:48:58.169292 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-a9bd3751-3a10-455d-bb12-0039e8836e0d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Getting quotas for project f4e017a4040d450aad862065563ea64d. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:48:58.173119 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-a9bd3751-3a10-455d-bb12-0039e8836e0d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Getting quotas for user e6a99e5d684a48a2845d3379e7df812c and project f4e017a4040d450aad862065563ea64d. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:48:58.215626 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a9bd3751-3a10-455d-bb12-0039e8836e0d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.065960 May 10 17:48:58.220399 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 259/522] 10.222.0.60 () {60 vars in 1158 bytes} [Tue May 10 17:48:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:48:58.816839 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a46f22e8-66f6-41e8-a027-87586d1995ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:48:58.817553 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a46f22e8-66f6-41e8-a027-87586d1995ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:48:58.824327 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a46f22e8-66f6-41e8-a027-87586d1995ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:58.824879 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a46f22e8-66f6-41e8-a027-87586d1995ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:58.825717 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a46f22e8-66f6-41e8-a027-87586d1995ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:48:58.826216 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a46f22e8-66f6-41e8-a027-87586d1995ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:48:59.017971 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a46f22e8-66f6-41e8-a027-87586d1995ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:59.026273 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a46f22e8-66f6-41e8-a027-87586d1995ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:59.027929 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a46f22e8-66f6-41e8-a027-87586d1995ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:48:59.029126 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a46f22e8-66f6-41e8-a027-87586d1995ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.216163 May 10 17:48:59.029878 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 264/523] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:48:58 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:48:59.645342 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-73b0a36d-fb92-4d86-a60e-ce4e5a6d8443 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-255187535", "imageRef": "a7737c62-8029-44aa-8da7-e46fea7607fb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a13d84d-c9e9-413f-a254-ca6edab95c78"}], "security_groups": [{"name": "tempest-securitygroup--587204535"}], "key_name": "tempest-keypair-1115855894", "user_data": "}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:48:59.746535 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-73b0a36d-fb92-4d86-a60e-ce4e5a6d8443 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] validate_networks() for [('5a13d84d-c9e9-413f-a254-ca6edab95c78', None, None, None, None, None)] {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:49:00.048862 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b6c3b8fa-cde1-4ed6-b335-c5517ffcc1c8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:00.049469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-b6c3b8fa-cde1-4ed6-b335-c5517ffcc1c8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:00.057349 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b6c3b8fa-cde1-4ed6-b335-c5517ffcc1c8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:00.057814 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b6c3b8fa-cde1-4ed6-b335-c5517ffcc1c8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:00.058609 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b6c3b8fa-cde1-4ed6-b335-c5517ffcc1c8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:00.059049 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b6c3b8fa-cde1-4ed6-b335-c5517ffcc1c8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:00.390882 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-73b0a36d-fb92-4d86-a60e-ce4e5a6d8443 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:49:00.391339 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-73b0a36d-fb92-4d86-a60e-ce4e5a6d8443 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:49:00.391861 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-73b0a36d-fb92-4d86-a60e-ce4e5a6d8443 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:49:00.392271 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-73b0a36d-fb92-4d86-a60e-ce4e5a6d8443 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:49:00.392693 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-73b0a36d-fb92-4d86-a60e-ce4e5a6d8443 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:49:00.403208 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-73b0a36d-fb92-4d86-a60e-ce4e5a6d8443 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:00.403705 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-73b0a36d-fb92-4d86-a60e-ce4e5a6d8443 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:00.404519 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-73b0a36d-fb92-4d86-a60e-ce4e5a6d8443 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:00.404969 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-73b0a36d-fb92-4d86-a60e-ce4e5a6d8443 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:00.407962 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b6c3b8fa-cde1-4ed6-b335-c5517ffcc1c8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:00.415743 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b6c3b8fa-cde1-4ed6-b335-c5517ffcc1c8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:00.417264 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b6c3b8fa-cde1-4ed6-b335-c5517ffcc1c8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:00.418557 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b6c3b8fa-cde1-4ed6-b335-c5517ffcc1c8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.374184 May 10 17:49:00.419127 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 265/524] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:00 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:49:00.423243 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-73b0a36d-fb92-4d86-a60e-ce4e5a6d8443 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Getting quotas for project f4e017a4040d450aad862065563ea64d. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:49:00.427285 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-73b0a36d-fb92-4d86-a60e-ce4e5a6d8443 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Getting quotas for user e6a99e5d684a48a2845d3379e7df812c and project f4e017a4040d450aad862065563ea64d. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:49:00.438247 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-73b0a36d-fb92-4d86-a60e-ce4e5a6d8443 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:49:00.440605 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-73b0a36d-fb92-4d86-a60e-ce4e5a6d8443 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7737c62-8029-44aa-8da7-e46fea7607fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:49:00.486709 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-73b0a36d-fb92-4d86-a60e-ce4e5a6d8443 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.846222 May 10 17:49:00.487343 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 260/525] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 17:48:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:49:00.498900 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4c2fb0b9-2083-4e55-99af-54be8c799d67 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:00.499540 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4c2fb0b9-2083-4e55-99af-54be8c799d67 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:00.552773 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4c2fb0b9-2083-4e55-99af-54be8c799d67 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:00.559775 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4c2fb0b9-2083-4e55-99af-54be8c799d67 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1241 microversion: 2.1 time: 0.065115 May 10 17:49:00.560358 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 266/526] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:00 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:49:01.439526 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-003d9c95-e4f4-42d9-b5c6-3c911e432f5f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:01.441312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-003d9c95-e4f4-42d9-b5c6-3c911e432f5f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:01.450073 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-003d9c95-e4f4-42d9-b5c6-3c911e432f5f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:01.451010 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-003d9c95-e4f4-42d9-b5c6-3c911e432f5f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:01.451357 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-003d9c95-e4f4-42d9-b5c6-3c911e432f5f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:01.451836 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-003d9c95-e4f4-42d9-b5c6-3c911e432f5f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:01.576446 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-35912616-d359-48d8-8417-f146691fa41f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:01.577194 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-35912616-d359-48d8-8417-f146691fa41f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:01.584294 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-35912616-d359-48d8-8417-f146691fa41f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:01.585029 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-35912616-d359-48d8-8417-f146691fa41f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:01.585809 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-35912616-d359-48d8-8417-f146691fa41f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:01.587104 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-35912616-d359-48d8-8417-f146691fa41f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:01.593118 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-003d9c95-e4f4-42d9-b5c6-3c911e432f5f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:01.608049 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-003d9c95-e4f4-42d9-b5c6-3c911e432f5f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:01.609572 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-003d9c95-e4f4-42d9-b5c6-3c911e432f5f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:01.610774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-003d9c95-e4f4-42d9-b5c6-3c911e432f5f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.177460 May 10 17:49:01.611341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 261/527] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:01 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:01.671659 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-35912616-d359-48d8-8417-f146691fa41f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:01.679468 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-35912616-d359-48d8-8417-f146691fa41f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1293 microversion: 2.1 time: 0.106683 May 10 17:49:01.679932 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 267/528] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:01 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1293 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:49:02.308414 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9bf95e2a-ccd1-4dda-a082-e7e6026380b0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1707914625", "imageRef": "a7737c62-8029-44aa-8da7-e46fea7607fb", "flavorRef": "452", "networks": [{"uuid": "29e73f79-8568-4d80-831b-136efa81b55a"}]}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:49:02.361455 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-9bf95e2a-ccd1-4dda-a082-e7e6026380b0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] validate_networks() for [('29e73f79-8568-4d80-831b-136efa81b55a', None, None, None, None, None)] {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:49:02.591730 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-139888a8-1769-4e27-a268-39952eb25b88 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc21f73b-9d3e-45b7-900e-8355407f13fe"}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:49:02.592921 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-139888a8-1769-4e27-a268-39952eb25b88 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:02.599388 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-139888a8-1769-4e27-a268-39952eb25b88 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:02.599852 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-139888a8-1769-4e27-a268-39952eb25b88 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:02.600626 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-139888a8-1769-4e27-a268-39952eb25b88 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:02.601069 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-139888a8-1769-4e27-a268-39952eb25b88 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:02.732687 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-9bf95e2a-ccd1-4dda-a082-e7e6026380b0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:49:02.733182 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-9bf95e2a-ccd1-4dda-a082-e7e6026380b0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:49:02.733575 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-9bf95e2a-ccd1-4dda-a082-e7e6026380b0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:49:02.733986 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-9bf95e2a-ccd1-4dda-a082-e7e6026380b0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:49:02.734398 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-9bf95e2a-ccd1-4dda-a082-e7e6026380b0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:49:02.743454 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9bf95e2a-ccd1-4dda-a082-e7e6026380b0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:02.743904 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9bf95e2a-ccd1-4dda-a082-e7e6026380b0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:02.744708 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9bf95e2a-ccd1-4dda-a082-e7e6026380b0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:02.745148 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9bf95e2a-ccd1-4dda-a082-e7e6026380b0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:02.761248 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-9bf95e2a-ccd1-4dda-a082-e7e6026380b0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Getting quotas for project 9a2c0807e3fc4161b894f123e8acc473. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:49:02.764950 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-9bf95e2a-ccd1-4dda-a082-e7e6026380b0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Getting quotas for user 37203169f06d42c59dc670dc416caf38 and project 9a2c0807e3fc4161b894f123e8acc473. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:49:02.775687 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9bf95e2a-ccd1-4dda-a082-e7e6026380b0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:49:02.777883 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9bf95e2a-ccd1-4dda-a082-e7e6026380b0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7737c62-8029-44aa-8da7-e46fea7607fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:49:02.823342 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9bf95e2a-ccd1-4dda-a082-e7e6026380b0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519662 May 10 17:49:02.824013 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 262/529] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 17:49:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:49:02.828553 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-230d28fb-ecb2-45b1-abe8-da8f97b89fe2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:02.829081 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-230d28fb-ecb2-45b1-abe8-da8f97b89fe2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:02.836184 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-230d28fb-ecb2-45b1-abe8-da8f97b89fe2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:02.836871 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-230d28fb-ecb2-45b1-abe8-da8f97b89fe2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:02.837920 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-230d28fb-ecb2-45b1-abe8-da8f97b89fe2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:02.839121 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-230d28fb-ecb2-45b1-abe8-da8f97b89fe2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:02.979143 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-230d28fb-ecb2-45b1-abe8-da8f97b89fe2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:02.987170 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-230d28fb-ecb2-45b1-abe8-da8f97b89fe2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:02.988648 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-230d28fb-ecb2-45b1-abe8-da8f97b89fe2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:02.990111 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-230d28fb-ecb2-45b1-abe8-da8f97b89fe2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.165084 May 10 17:49:02.990727 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 263/530] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:02 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:02.998608 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9ab93b3c-acc9-40b9-8fba-8333f427d23c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:02.999289 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9ab93b3c-acc9-40b9-8fba-8333f427d23c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:03.005325 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ab93b3c-acc9-40b9-8fba-8333f427d23c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:03.005782 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ab93b3c-acc9-40b9-8fba-8333f427d23c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:03.006566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ab93b3c-acc9-40b9-8fba-8333f427d23c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:03.007009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ab93b3c-acc9-40b9-8fba-8333f427d23c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:03.082201 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9ab93b3c-acc9-40b9-8fba-8333f427d23c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:03.091731 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9ab93b3c-acc9-40b9-8fba-8333f427d23c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1299 microversion: 2.1 time: 0.099727 May 10 17:49:03.101194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 264/531] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:02 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:03.101194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f670183f-b91b-416c-9a74-e3e5440828b6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:03.101194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f670183f-b91b-416c-9a74-e3e5440828b6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:03.169975 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f670183f-b91b-416c-9a74-e3e5440828b6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:03.182486 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f670183f-b91b-416c-9a74-e3e5440828b6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1219 microversion: 2.1 time: 0.088816 May 10 17:49:03.183790 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 265/532] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:03 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:03.407596 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-139888a8-1769-4e27-a268-39952eb25b88 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "POST /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.819764 May 10 17:49:03.408215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 268/533] 10.222.0.60 () {60 vars in 1322 bytes} [Tue May 10 17:49:02 2022] POST /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb/os-volume_attachments => generated 194 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:49:04.018379 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6af13af4-db24-47dc-aed5-33ffa343dd63 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:04.022065 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6af13af4-db24-47dc-aed5-33ffa343dd63 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:04.046845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6af13af4-db24-47dc-aed5-33ffa343dd63 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:04.047553 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6af13af4-db24-47dc-aed5-33ffa343dd63 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:04.049020 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6af13af4-db24-47dc-aed5-33ffa343dd63 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:04.049545 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6af13af4-db24-47dc-aed5-33ffa343dd63 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:04.111677 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2009d703-5a4a-47ee-91ac-c4c6e3b65725 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:04.113147 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-2009d703-5a4a-47ee-91ac-c4c6e3b65725 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:04.121868 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2009d703-5a4a-47ee-91ac-c4c6e3b65725 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:04.122578 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2009d703-5a4a-47ee-91ac-c4c6e3b65725 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:04.123732 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2009d703-5a4a-47ee-91ac-c4c6e3b65725 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:04.124340 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2009d703-5a4a-47ee-91ac-c4c6e3b65725 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:04.442938 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-2009d703-5a4a-47ee-91ac-c4c6e3b65725 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:04.452023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-2009d703-5a4a-47ee-91ac-c4c6e3b65725 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1366 microversion: 2.1 time: 0.345418 May 10 17:49:04.462483 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 269/534] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:04 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:04.462706 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6af13af4-db24-47dc-aed5-33ffa343dd63 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:04.469980 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8b8fff19-f297-4f1f-96f8-e7fb18a58bcc tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:04.470607 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8b8fff19-f297-4f1f-96f8-e7fb18a58bcc tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:04.471057 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6af13af4-db24-47dc-aed5-33ffa343dd63 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:04.473016 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6af13af4-db24-47dc-aed5-33ffa343dd63 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:04.475437 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6af13af4-db24-47dc-aed5-33ffa343dd63 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1745 microversion: 2.20 time: 0.469188 May 10 17:49:04.476226 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 266/535] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:04 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1745 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:04.477910 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8b8fff19-f297-4f1f-96f8-e7fb18a58bcc tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:04.478364 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8b8fff19-f297-4f1f-96f8-e7fb18a58bcc tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:04.479203 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8b8fff19-f297-4f1f-96f8-e7fb18a58bcc tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:04.479693 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8b8fff19-f297-4f1f-96f8-e7fb18a58bcc tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:04.576786 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-8b8fff19-f297-4f1f-96f8-e7fb18a58bcc tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:04.586423 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8b8fff19-f297-4f1f-96f8-e7fb18a58bcc tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1277 microversion: 2.1 time: 0.132565 May 10 17:49:04.587157 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 270/536] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:04 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1277 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:04.922567 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-22742d0a-3058-4b6a-a779-f4e3dbdfcc31 req-166dceeb-44e0-49c3-9a28-79cfd904f78f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab2c473c-6e44-4cb5-8ddb-128a2061ae50", "tag": "9eecfcd3-4266-44a2-966e-218d7a2c006e"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:49:04.932489 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-22742d0a-3058-4b6a-a779-f4e3dbdfcc31 req-166dceeb-44e0-49c3-9a28-79cfd904f78f service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:04.932881 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-22742d0a-3058-4b6a-a779-f4e3dbdfcc31 req-166dceeb-44e0-49c3-9a28-79cfd904f78f service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:04.947654 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-22742d0a-3058-4b6a-a779-f4e3dbdfcc31 req-166dceeb-44e0-49c3-9a28-79cfd904f78f service nova] Creating event network-changed:9eecfcd3-4266-44a2-966e-218d7a2c006e for instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 on hv-cinder-84130 May 10 17:49:04.956611 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-22742d0a-3058-4b6a-a779-f4e3dbdfcc31 req-166dceeb-44e0-49c3-9a28-79cfd904f78f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038556 May 10 17:49:04.957742 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 267/537] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:49:05.469856 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-6dcae6c7-1bb4-466a-999f-7ae9ab61040a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:05.470490 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-6dcae6c7-1bb4-466a-999f-7ae9ab61040a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:05.478139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6dcae6c7-1bb4-466a-999f-7ae9ab61040a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:05.478546 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6dcae6c7-1bb4-466a-999f-7ae9ab61040a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:05.479343 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6dcae6c7-1bb4-466a-999f-7ae9ab61040a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:05.479806 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6dcae6c7-1bb4-466a-999f-7ae9ab61040a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:05.495582 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ac0f16f4-ce56-40a4-a504-442ad344ddaa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:05.496287 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ac0f16f4-ce56-40a4-a504-442ad344ddaa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:05.517467 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ac0f16f4-ce56-40a4-a504-442ad344ddaa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:05.517933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ac0f16f4-ce56-40a4-a504-442ad344ddaa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:05.518790 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ac0f16f4-ce56-40a4-a504-442ad344ddaa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:05.519242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ac0f16f4-ce56-40a4-a504-442ad344ddaa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:05.716949 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6dcae6c7-1bb4-466a-999f-7ae9ab61040a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:05.724570 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-6dcae6c7-1bb4-466a-999f-7ae9ab61040a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1366 microversion: 2.1 time: 0.258536 May 10 17:49:05.725163 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 271/538] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:05 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:05.726021 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ac0f16f4-ce56-40a4-a504-442ad344ddaa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:05.731019 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ada19d18-5ceb-4a45-9b70-1a6514f68446 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:05.731924 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ada19d18-5ceb-4a45-9b70-1a6514f68446 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:05.734552 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ac0f16f4-ce56-40a4-a504-442ad344ddaa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:05.736107 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ac0f16f4-ce56-40a4-a504-442ad344ddaa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:05.737575 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ac0f16f4-ce56-40a4-a504-442ad344ddaa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1745 microversion: 2.20 time: 0.247154 May 10 17:49:05.738109 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ada19d18-5ceb-4a45-9b70-1a6514f68446 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:05.738571 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ada19d18-5ceb-4a45-9b70-1a6514f68446 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:05.739390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ada19d18-5ceb-4a45-9b70-1a6514f68446 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:05.739838 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ada19d18-5ceb-4a45-9b70-1a6514f68446 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:05.748214 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 268/539] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:05 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1745 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:49:05.794291 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-dd09a8f7-9d11-47e2-b76d-7ebbd87fec2c req-540af9cf-73b0-4e0a-9fad-f0adcd20ac7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4adcaebe-b2a0-4861-a874-24cbcdc8cd05", "tag": "4067eee9-a186-4e93-ba0a-31a799761eab"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:49:05.803400 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-dd09a8f7-9d11-47e2-b76d-7ebbd87fec2c req-540af9cf-73b0-4e0a-9fad-f0adcd20ac7d service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:05.803858 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-dd09a8f7-9d11-47e2-b76d-7ebbd87fec2c req-540af9cf-73b0-4e0a-9fad-f0adcd20ac7d service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:05.817912 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-dd09a8f7-9d11-47e2-b76d-7ebbd87fec2c req-540af9cf-73b0-4e0a-9fad-f0adcd20ac7d service nova] Creating event network-changed:4067eee9-a186-4e93-ba0a-31a799761eab for instance 4adcaebe-b2a0-4861-a874-24cbcdc8cd05 on hv-cinder-84130 May 10 17:49:05.824553 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-dd09a8f7-9d11-47e2-b76d-7ebbd87fec2c req-540af9cf-73b0-4e0a-9fad-f0adcd20ac7d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035686 May 10 17:49:05.825172 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 269/540] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:49:05.894262 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ada19d18-5ceb-4a45-9b70-1a6514f68446 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:05.905014 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ada19d18-5ceb-4a45-9b70-1a6514f68446 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1319 microversion: 2.1 time: 0.178389 May 10 17:49:05.905416 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 272/541] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:05 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:06.742995 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d7722c3d-51e3-4955-99b4-0a30b92b99c0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:06.743722 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d7722c3d-51e3-4955-99b4-0a30b92b99c0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:06.750028 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d7722c3d-51e3-4955-99b4-0a30b92b99c0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:06.750729 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d7722c3d-51e3-4955-99b4-0a30b92b99c0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:06.751256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d7722c3d-51e3-4955-99b4-0a30b92b99c0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:06.751723 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d7722c3d-51e3-4955-99b4-0a30b92b99c0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:06.756352 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-08e9ca8f-07d6-4be9-a39a-a1532d8dcac8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:06.756971 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-08e9ca8f-07d6-4be9-a39a-a1532d8dcac8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:06.764213 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-08e9ca8f-07d6-4be9-a39a-a1532d8dcac8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:06.764674 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-08e9ca8f-07d6-4be9-a39a-a1532d8dcac8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:06.765460 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-08e9ca8f-07d6-4be9-a39a-a1532d8dcac8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:06.765897 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-08e9ca8f-07d6-4be9-a39a-a1532d8dcac8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:06.971342 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d7722c3d-51e3-4955-99b4-0a30b92b99c0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:06.979055 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d7722c3d-51e3-4955-99b4-0a30b92b99c0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1366 microversion: 2.1 time: 0.241052 May 10 17:49:06.979777 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 270/542] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:06 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:06.984342 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-08e9ca8f-07d6-4be9-a39a-a1532d8dcac8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:06.985447 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-003ed2d4-3c7c-48f5-b424-62cc9e05badf tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:06.986066 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-003ed2d4-3c7c-48f5-b424-62cc9e05badf tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:06.992674 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-003ed2d4-3c7c-48f5-b424-62cc9e05badf tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:06.993229 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-003ed2d4-3c7c-48f5-b424-62cc9e05badf tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:06.994123 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-08e9ca8f-07d6-4be9-a39a-a1532d8dcac8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:06.994265 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-003ed2d4-3c7c-48f5-b424-62cc9e05badf tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:06.994661 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-003ed2d4-3c7c-48f5-b424-62cc9e05badf tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:06.996277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-08e9ca8f-07d6-4be9-a39a-a1532d8dcac8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:06.997737 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-08e9ca8f-07d6-4be9-a39a-a1532d8dcac8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1745 microversion: 2.20 time: 0.245422 May 10 17:49:06.999253 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 273/543] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:06 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1745 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:49:07.140333 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-003ed2d4-3c7c-48f5-b424-62cc9e05badf tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:07.148288 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-003ed2d4-3c7c-48f5-b424-62cc9e05badf tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1319 microversion: 2.1 time: 0.167354 May 10 17:49:07.149515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 271/544] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:06 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:07.168830 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-ed99d12a-2a2c-4bc8-948f-484df13291ea req-6801c622-876f-4dc4-879d-bbb2ea451224 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4006eed6-2338-46b7-9133-e5c3fdead35c", "name": "network-vif-plugged", "status": "completed", "tag": "e697d9cb-ff2b-45a4-8326-f3219cdf4121"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:49:07.178110 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-ed99d12a-2a2c-4bc8-948f-484df13291ea req-6801c622-876f-4dc4-879d-bbb2ea451224 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:07.178556 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-ed99d12a-2a2c-4bc8-948f-484df13291ea req-6801c622-876f-4dc4-879d-bbb2ea451224 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:07.191456 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-ed99d12a-2a2c-4bc8-948f-484df13291ea req-6801c622-876f-4dc4-879d-bbb2ea451224 service nova] Creating event network-vif-plugged:e697d9cb-ff2b-45a4-8326-f3219cdf4121 for instance 4006eed6-2338-46b7-9133-e5c3fdead35c on hv-cinder-84130 May 10 17:49:07.197852 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-ed99d12a-2a2c-4bc8-948f-484df13291ea req-6801c622-876f-4dc4-879d-bbb2ea451224 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033123 May 10 17:49:07.198465 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 274/545] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:49:07.996701 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d787eade-c6d3-4ced-979a-fe5da3b9644a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:07.997297 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d787eade-c6d3-4ced-979a-fe5da3b9644a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:08.004366 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d787eade-c6d3-4ced-979a-fe5da3b9644a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:08.004821 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d787eade-c6d3-4ced-979a-fe5da3b9644a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:08.005614 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d787eade-c6d3-4ced-979a-fe5da3b9644a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:08.006071 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d787eade-c6d3-4ced-979a-fe5da3b9644a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:08.020015 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7e1f0877-20f0-4c76-9c6a-23b9922cd1db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:08.020739 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7e1f0877-20f0-4c76-9c6a-23b9922cd1db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:08.028077 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7e1f0877-20f0-4c76-9c6a-23b9922cd1db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:08.028540 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7e1f0877-20f0-4c76-9c6a-23b9922cd1db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:08.029348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7e1f0877-20f0-4c76-9c6a-23b9922cd1db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:08.029795 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7e1f0877-20f0-4c76-9c6a-23b9922cd1db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:08.215975 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d787eade-c6d3-4ced-979a-fe5da3b9644a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:08.228080 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7e1f0877-20f0-4c76-9c6a-23b9922cd1db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:08.229792 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d787eade-c6d3-4ced-979a-fe5da3b9644a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1366 microversion: 2.1 time: 0.237113 May 10 17:49:08.230855 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 272/546] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:07 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:08.236658 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7e1f0877-20f0-4c76-9c6a-23b9922cd1db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:08.238156 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7e1f0877-20f0-4c76-9c6a-23b9922cd1db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:08.239191 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ee9e98f8-7da5-49e5-89fb-ab0c1cb94746 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:08.239415 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7e1f0877-20f0-4c76-9c6a-23b9922cd1db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1745 microversion: 2.20 time: 0.225843 May 10 17:49:08.240237 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ee9e98f8-7da5-49e5-89fb-ab0c1cb94746 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:08.241006 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 275/547] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:08 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1745 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:49:08.250006 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ee9e98f8-7da5-49e5-89fb-ab0c1cb94746 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:08.250756 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ee9e98f8-7da5-49e5-89fb-ab0c1cb94746 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:08.251974 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ee9e98f8-7da5-49e5-89fb-ab0c1cb94746 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:08.252822 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ee9e98f8-7da5-49e5-89fb-ab0c1cb94746 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:08.413583 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ee9e98f8-7da5-49e5-89fb-ab0c1cb94746 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:08.421349 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ee9e98f8-7da5-49e5-89fb-ab0c1cb94746 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1319 microversion: 2.1 time: 0.189039 May 10 17:49:08.421919 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 273/548] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:08 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:09.249886 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-028ecd02-71a5-43fd-9301-b355f02ef189 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:09.251348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-028ecd02-71a5-43fd-9301-b355f02ef189 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:09.258574 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4efca0b3-909b-4e9d-954d-01f477c6e1a5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:09.258574 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4efca0b3-909b-4e9d-954d-01f477c6e1a5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:09.260133 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-028ecd02-71a5-43fd-9301-b355f02ef189 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:09.260430 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-028ecd02-71a5-43fd-9301-b355f02ef189 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:09.261297 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-028ecd02-71a5-43fd-9301-b355f02ef189 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:09.262023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-028ecd02-71a5-43fd-9301-b355f02ef189 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:09.267440 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4efca0b3-909b-4e9d-954d-01f477c6e1a5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:09.268056 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4efca0b3-909b-4e9d-954d-01f477c6e1a5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:09.268870 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4efca0b3-909b-4e9d-954d-01f477c6e1a5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:09.269307 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4efca0b3-909b-4e9d-954d-01f477c6e1a5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:09.463827 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-028ecd02-71a5-43fd-9301-b355f02ef189 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:09.472424 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-028ecd02-71a5-43fd-9301-b355f02ef189 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1366 microversion: 2.1 time: 0.228273 May 10 17:49:09.473189 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 276/549] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:09 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:09.475649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4efca0b3-909b-4e9d-954d-01f477c6e1a5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:09.478546 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-0c9ab64c-461c-4f7c-984c-db8991ef9e18 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:09.479263 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-0c9ab64c-461c-4f7c-984c-db8991ef9e18 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:09.487764 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4efca0b3-909b-4e9d-954d-01f477c6e1a5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:09.488090 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0c9ab64c-461c-4f7c-984c-db8991ef9e18 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:09.488324 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0c9ab64c-461c-4f7c-984c-db8991ef9e18 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:09.489114 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4efca0b3-909b-4e9d-954d-01f477c6e1a5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:09.489314 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0c9ab64c-461c-4f7c-984c-db8991ef9e18 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:09.489723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0c9ab64c-461c-4f7c-984c-db8991ef9e18 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:09.490315 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4efca0b3-909b-4e9d-954d-01f477c6e1a5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1745 microversion: 2.20 time: 0.236896 May 10 17:49:09.491215 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 274/550] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:09 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1745 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:49:09.832901 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-0c9ab64c-461c-4f7c-984c-db8991ef9e18 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:09.845675 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-0c9ab64c-461c-4f7c-984c-db8991ef9e18 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1319 microversion: 2.1 time: 0.371375 May 10 17:49:09.846427 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 277/551] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:09 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:10.490352 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-67dc4ce4-a2e2-4793-9fd5-55860cb138a7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:10.490994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-67dc4ce4-a2e2-4793-9fd5-55860cb138a7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:10.497626 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-67dc4ce4-a2e2-4793-9fd5-55860cb138a7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:10.498080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-67dc4ce4-a2e2-4793-9fd5-55860cb138a7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:10.498860 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-67dc4ce4-a2e2-4793-9fd5-55860cb138a7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:10.499298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-67dc4ce4-a2e2-4793-9fd5-55860cb138a7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:10.510698 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1aa8a63b-3bc2-4495-860d-6eceff5184ed tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:10.511310 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-1aa8a63b-3bc2-4495-860d-6eceff5184ed tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:10.517652 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1aa8a63b-3bc2-4495-860d-6eceff5184ed tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:10.518090 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1aa8a63b-3bc2-4495-860d-6eceff5184ed tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:10.518859 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1aa8a63b-3bc2-4495-860d-6eceff5184ed tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:10.519295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1aa8a63b-3bc2-4495-860d-6eceff5184ed tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:10.693967 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-67dc4ce4-a2e2-4793-9fd5-55860cb138a7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:10.702939 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-67dc4ce4-a2e2-4793-9fd5-55860cb138a7 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1366 microversion: 2.1 time: 0.216437 May 10 17:49:10.703997 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 275/552] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:10 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:10.706112 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1aa8a63b-3bc2-4495-860d-6eceff5184ed tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:10.714152 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1aa8a63b-3bc2-4495-860d-6eceff5184ed tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:10.715681 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1aa8a63b-3bc2-4495-860d-6eceff5184ed tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:10.716844 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-1aa8a63b-3bc2-4495-860d-6eceff5184ed tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1745 microversion: 2.20 time: 0.210099 May 10 17:49:10.717397 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 278/553] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:10 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1745 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:49:10.867029 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7b8c1bc6-2c42-4d72-a36f-b753a998e51e tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:10.868317 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7b8c1bc6-2c42-4d72-a36f-b753a998e51e tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:10.875158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b8c1bc6-2c42-4d72-a36f-b753a998e51e tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:10.875700 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b8c1bc6-2c42-4d72-a36f-b753a998e51e tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:10.876670 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b8c1bc6-2c42-4d72-a36f-b753a998e51e tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:10.877463 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b8c1bc6-2c42-4d72-a36f-b753a998e51e tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:11.016714 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7b8c1bc6-2c42-4d72-a36f-b753a998e51e tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:11.024549 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7b8c1bc6-2c42-4d72-a36f-b753a998e51e tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1319 microversion: 2.1 time: 0.166422 May 10 17:49:11.025139 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 276/554] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:10 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:11.720018 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2700696c-03f8-45da-b898-50296ea81eb8 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:11.720658 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-2700696c-03f8-45da-b898-50296ea81eb8 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:11.727756 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2700696c-03f8-45da-b898-50296ea81eb8 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:11.728202 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2700696c-03f8-45da-b898-50296ea81eb8 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:11.728998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2700696c-03f8-45da-b898-50296ea81eb8 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:11.729436 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2700696c-03f8-45da-b898-50296ea81eb8 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:11.735255 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1e80ebd6-d03f-4fac-8a83-bdef6907edfb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:11.735895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1e80ebd6-d03f-4fac-8a83-bdef6907edfb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:11.744210 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1e80ebd6-d03f-4fac-8a83-bdef6907edfb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:11.744599 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1e80ebd6-d03f-4fac-8a83-bdef6907edfb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:11.745384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1e80ebd6-d03f-4fac-8a83-bdef6907edfb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:11.745830 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1e80ebd6-d03f-4fac-8a83-bdef6907edfb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:11.917874 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-2700696c-03f8-45da-b898-50296ea81eb8 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:11.925217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-2700696c-03f8-45da-b898-50296ea81eb8 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1366 microversion: 2.1 time: 0.208967 May 10 17:49:11.925795 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 279/555] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:11 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:11.929117 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1e80ebd6-d03f-4fac-8a83-bdef6907edfb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:11.937796 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1e80ebd6-d03f-4fac-8a83-bdef6907edfb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:11.939778 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1e80ebd6-d03f-4fac-8a83-bdef6907edfb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:11.941127 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1e80ebd6-d03f-4fac-8a83-bdef6907edfb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1745 microversion: 2.20 time: 0.209882 May 10 17:49:11.953142 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 277/556] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:11 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1745 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:12.044139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-088a7c11-c03b-4d10-972a-e0e96e4ff5e6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:12.045418 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-088a7c11-c03b-4d10-972a-e0e96e4ff5e6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:12.052173 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-088a7c11-c03b-4d10-972a-e0e96e4ff5e6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:12.053124 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-088a7c11-c03b-4d10-972a-e0e96e4ff5e6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:12.054290 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-088a7c11-c03b-4d10-972a-e0e96e4ff5e6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:12.055222 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-088a7c11-c03b-4d10-972a-e0e96e4ff5e6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:12.511904 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-088a7c11-c03b-4d10-972a-e0e96e4ff5e6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:12.520208 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-088a7c11-c03b-4d10-972a-e0e96e4ff5e6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1319 microversion: 2.1 time: 0.482077 May 10 17:49:12.520794 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 280/557] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:12 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1319 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:12.943502 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-653ea404-7e88-46af-a551-e1ea105be5df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:12.944130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-653ea404-7e88-46af-a551-e1ea105be5df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:12.951383 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-653ea404-7e88-46af-a551-e1ea105be5df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:12.951848 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-653ea404-7e88-46af-a551-e1ea105be5df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:12.952610 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-653ea404-7e88-46af-a551-e1ea105be5df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:12.953042 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-653ea404-7e88-46af-a551-e1ea105be5df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:12.959563 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-bfbdecaf-e2d2-4729-ad5a-a03cc60162d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:12.960176 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-bfbdecaf-e2d2-4729-ad5a-a03cc60162d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:12.966594 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bfbdecaf-e2d2-4729-ad5a-a03cc60162d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:12.967048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bfbdecaf-e2d2-4729-ad5a-a03cc60162d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:12.967845 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bfbdecaf-e2d2-4729-ad5a-a03cc60162d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:12.968285 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bfbdecaf-e2d2-4729-ad5a-a03cc60162d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:13.152193 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-653ea404-7e88-46af-a551-e1ea105be5df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:13.159282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-bfbdecaf-e2d2-4729-ad5a-a03cc60162d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:13.159509 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-653ea404-7e88-46af-a551-e1ea105be5df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1366 microversion: 2.1 time: 0.219721 May 10 17:49:13.159947 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 278/558] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:12 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:13.165032 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-98b53973-09dc-4992-9f73-bdc8c45d7c20 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:13.165825 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-98b53973-09dc-4992-9f73-bdc8c45d7c20 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:13.168158 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-bfbdecaf-e2d2-4729-ad5a-a03cc60162d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:13.169659 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-bfbdecaf-e2d2-4729-ad5a-a03cc60162d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:13.170851 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-bfbdecaf-e2d2-4729-ad5a-a03cc60162d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1745 microversion: 2.20 time: 0.215171 May 10 17:49:13.171424 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 281/559] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:12 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1745 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:49:13.175197 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98b53973-09dc-4992-9f73-bdc8c45d7c20 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:13.175707 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98b53973-09dc-4992-9f73-bdc8c45d7c20 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:13.176501 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98b53973-09dc-4992-9f73-bdc8c45d7c20 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:13.176938 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98b53973-09dc-4992-9f73-bdc8c45d7c20 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:13.313698 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-98b53973-09dc-4992-9f73-bdc8c45d7c20 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:13.322217 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-98b53973-09dc-4992-9f73-bdc8c45d7c20 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1594 microversion: 2.1 time: 0.160959 May 10 17:49:13.322801 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 279/560] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:13 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1594 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:13.539010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a42a5016-5981-4267-a57a-39ba985c4d54 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:13.541018 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a42a5016-5981-4267-a57a-39ba985c4d54 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:13.548220 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a42a5016-5981-4267-a57a-39ba985c4d54 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:13.548682 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a42a5016-5981-4267-a57a-39ba985c4d54 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:13.549476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a42a5016-5981-4267-a57a-39ba985c4d54 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:13.549923 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a42a5016-5981-4267-a57a-39ba985c4d54 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:13.760323 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a42a5016-5981-4267-a57a-39ba985c4d54 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:13.768032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a42a5016-5981-4267-a57a-39ba985c4d54 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1319 microversion: 2.1 time: 0.233646 May 10 17:49:13.768619 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 282/561] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:13 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:14.177241 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4fc0dddb-b144-4aa6-9890-74fc166ead86 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:14.177902 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4fc0dddb-b144-4aa6-9890-74fc166ead86 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:14.189120 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7fe49b14-49b2-4fa6-b924-4dd4048ae91b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:14.189757 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7fe49b14-49b2-4fa6-b924-4dd4048ae91b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:14.198029 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4fc0dddb-b144-4aa6-9890-74fc166ead86 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:14.198485 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4fc0dddb-b144-4aa6-9890-74fc166ead86 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:14.199285 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4fc0dddb-b144-4aa6-9890-74fc166ead86 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:14.199753 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4fc0dddb-b144-4aa6-9890-74fc166ead86 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:14.203531 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7fe49b14-49b2-4fa6-b924-4dd4048ae91b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:14.203993 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7fe49b14-49b2-4fa6-b924-4dd4048ae91b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:14.204787 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7fe49b14-49b2-4fa6-b924-4dd4048ae91b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:14.205229 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7fe49b14-49b2-4fa6-b924-4dd4048ae91b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:14.498236 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7fe49b14-49b2-4fa6-b924-4dd4048ae91b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:14.506139 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4fc0dddb-b144-4aa6-9890-74fc166ead86 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:14.506782 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7fe49b14-49b2-4fa6-b924-4dd4048ae91b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:14.509402 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7fe49b14-49b2-4fa6-b924-4dd4048ae91b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:14.510838 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7fe49b14-49b2-4fa6-b924-4dd4048ae91b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1745 microversion: 2.20 time: 0.325602 May 10 17:49:14.511419 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 283/562] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:14 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1745 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:49:14.516082 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-49d307d1-8a60-4ea6-ab2a-b6a6f74069a8 req-493ca2cf-2648-40ff-b535-a79d2ceda1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2c473c-6e44-4cb5-8ddb-128a2061ae50", "name": "network-vif-plugged", "status": "completed", "tag": "9eecfcd3-4266-44a2-966e-218d7a2c006e"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:49:14.525651 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-49d307d1-8a60-4ea6-ab2a-b6a6f74069a8 req-493ca2cf-2648-40ff-b535-a79d2ceda1cf service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:14.526114 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-49d307d1-8a60-4ea6-ab2a-b6a6f74069a8 req-493ca2cf-2648-40ff-b535-a79d2ceda1cf service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:14.526350 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4fc0dddb-b144-4aa6-9890-74fc166ead86 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1366 microversion: 2.1 time: 0.353483 May 10 17:49:14.527132 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 280/563] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:14 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1366 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:14.549036 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-49d307d1-8a60-4ea6-ab2a-b6a6f74069a8 req-493ca2cf-2648-40ff-b535-a79d2ceda1cf service nova] Creating event network-vif-plugged:9eecfcd3-4266-44a2-966e-218d7a2c006e for instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 on hv-cinder-84130 May 10 17:49:14.554502 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-49d307d1-8a60-4ea6-ab2a-b6a6f74069a8 req-493ca2cf-2648-40ff-b535-a79d2ceda1cf service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041697 May 10 17:49:14.556256 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 284/564] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:49:14.785747 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8aa7f104-5856-4aae-bf8c-841653d3b232 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:14.786532 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8aa7f104-5856-4aae-bf8c-841653d3b232 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:14.793513 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8aa7f104-5856-4aae-bf8c-841653d3b232 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:14.793973 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8aa7f104-5856-4aae-bf8c-841653d3b232 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:14.795008 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8aa7f104-5856-4aae-bf8c-841653d3b232 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:14.795530 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8aa7f104-5856-4aae-bf8c-841653d3b232 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:15.032859 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8aa7f104-5856-4aae-bf8c-841653d3b232 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:15.040990 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8aa7f104-5856-4aae-bf8c-841653d3b232 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1319 microversion: 2.1 time: 0.259062 May 10 17:49:15.041758 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 281/565] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:14 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:15.435343 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-c5abf411-0582-4bd9-b870-c42b40e35c2d req-eca05c87-789f-4a82-b7f3-104006d7ad48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab1a9bd-b249-4f09-9264-87eb2a4878cb", "tag": "f023603c-ec90-40f8-beef-59e8c9f7f17f"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:49:15.446480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-c5abf411-0582-4bd9-b870-c42b40e35c2d req-eca05c87-789f-4a82-b7f3-104006d7ad48 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:15.447522 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-c5abf411-0582-4bd9-b870-c42b40e35c2d req-eca05c87-789f-4a82-b7f3-104006d7ad48 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:15.459531 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-c5abf411-0582-4bd9-b870-c42b40e35c2d req-eca05c87-789f-4a82-b7f3-104006d7ad48 service nova] Creating event network-changed:f023603c-ec90-40f8-beef-59e8c9f7f17f for instance 4ab1a9bd-b249-4f09-9264-87eb2a4878cb on hv-cinder-84130 May 10 17:49:15.465236 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-c5abf411-0582-4bd9-b870-c42b40e35c2d req-eca05c87-789f-4a82-b7f3-104006d7ad48 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037061 May 10 17:49:15.465853 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 285/566] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:49:15.531175 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c14adc31-e261-4c9a-8bb8-25bf06a32976 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:15.532101 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c14adc31-e261-4c9a-8bb8-25bf06a32976 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:15.539413 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c14adc31-e261-4c9a-8bb8-25bf06a32976 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:15.540424 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c14adc31-e261-4c9a-8bb8-25bf06a32976 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:15.542045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c14adc31-e261-4c9a-8bb8-25bf06a32976 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:15.542957 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c14adc31-e261-4c9a-8bb8-25bf06a32976 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:15.547161 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c94dbb77-d336-4578-aac8-371768fa1182 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:15.547939 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c94dbb77-d336-4578-aac8-371768fa1182 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:15.557024 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c94dbb77-d336-4578-aac8-371768fa1182 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:15.557685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c94dbb77-d336-4578-aac8-371768fa1182 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:15.559330 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c94dbb77-d336-4578-aac8-371768fa1182 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:15.560252 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c94dbb77-d336-4578-aac8-371768fa1182 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:15.799900 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c94dbb77-d336-4578-aac8-371768fa1182 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:15.801832 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c14adc31-e261-4c9a-8bb8-25bf06a32976 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:15.808915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c94dbb77-d336-4578-aac8-371768fa1182 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1366 microversion: 2.1 time: 0.268128 May 10 17:49:15.818705 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 286/567] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:15 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:15.821438 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c14adc31-e261-4c9a-8bb8-25bf06a32976 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:15.823681 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c14adc31-e261-4c9a-8bb8-25bf06a32976 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:15.825178 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c14adc31-e261-4c9a-8bb8-25bf06a32976 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1745 microversion: 2.20 time: 0.299150 May 10 17:49:15.825759 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 282/568] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:15 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1745 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:16.057901 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9c3501fe-4e2d-46bc-9a52-5a085d7c8632 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:16.059382 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-9c3501fe-4e2d-46bc-9a52-5a085d7c8632 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:16.072445 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9c3501fe-4e2d-46bc-9a52-5a085d7c8632 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:16.073012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9c3501fe-4e2d-46bc-9a52-5a085d7c8632 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:16.073905 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9c3501fe-4e2d-46bc-9a52-5a085d7c8632 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:16.074471 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9c3501fe-4e2d-46bc-9a52-5a085d7c8632 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:16.295958 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-9c3501fe-4e2d-46bc-9a52-5a085d7c8632 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:16.306806 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-9c3501fe-4e2d-46bc-9a52-5a085d7c8632 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1319 microversion: 2.1 time: 0.253767 May 10 17:49:16.318805 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 287/569] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:16 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:16.588833 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b88af96b-48bd-4c7c-9353-7de47469d089 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1770949354"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:49:16.590115 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b88af96b-48bd-4c7c-9353-7de47469d089 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:16.599787 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b88af96b-48bd-4c7c-9353-7de47469d089 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:16.600249 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b88af96b-48bd-4c7c-9353-7de47469d089 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:16.601242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b88af96b-48bd-4c7c-9353-7de47469d089 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:16.601840 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b88af96b-48bd-4c7c-9353-7de47469d089 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:16.828417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4d253172-06a8-468c-80ab-eb9bdfc71d0c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:16.829686 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4d253172-06a8-468c-80ab-eb9bdfc71d0c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:16.838314 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4d253172-06a8-468c-80ab-eb9bdfc71d0c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:16.839318 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4d253172-06a8-468c-80ab-eb9bdfc71d0c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:16.842185 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4d253172-06a8-468c-80ab-eb9bdfc71d0c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:16.842793 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4d253172-06a8-468c-80ab-eb9bdfc71d0c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:16.889119 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.network.security_group_api [None req-b88af96b-48bd-4c7c-9353-7de47469d089 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Adding security group 8efa01d5-e8fd-47b7-b10c-1647c0ca187c to port f023603c-ec90-40f8-beef-59e8c9f7f17f May 10 17:49:17.081800 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4d253172-06a8-468c-80ab-eb9bdfc71d0c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:17.092445 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4d253172-06a8-468c-80ab-eb9bdfc71d0c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1366 microversion: 2.1 time: 0.269154 May 10 17:49:17.104974 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 288/570] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:16 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:49:17.113005 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-004714b0-9866-4809-85dc-a6b9b201d1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:17.115114 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-004714b0-9866-4809-85dc-a6b9b201d1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:17.125314 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-004714b0-9866-4809-85dc-a6b9b201d1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:17.125930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-004714b0-9866-4809-85dc-a6b9b201d1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:17.126840 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-004714b0-9866-4809-85dc-a6b9b201d1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:17.127404 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-004714b0-9866-4809-85dc-a6b9b201d1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:17.388402 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-004714b0-9866-4809-85dc-a6b9b201d1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:17.402957 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-004714b0-9866-4809-85dc-a6b9b201d1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:17.405365 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-004714b0-9866-4809-85dc-a6b9b201d1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:17.406832 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-004714b0-9866-4809-85dc-a6b9b201d1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1740 microversion: 2.20 time: 0.300639 May 10 17:49:17.407418 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 289/571] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:17 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:17.412687 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7607187d-182c-40f5-a68a-be6ba812ace0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:17.413557 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7607187d-182c-40f5-a68a-be6ba812ace0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:17.421754 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7607187d-182c-40f5-a68a-be6ba812ace0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:17.422207 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7607187d-182c-40f5-a68a-be6ba812ace0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:17.422987 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7607187d-182c-40f5-a68a-be6ba812ace0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:17.423478 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7607187d-182c-40f5-a68a-be6ba812ace0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:17.572184 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b88af96b-48bd-4c7c-9353-7de47469d089 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "POST /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb/action" status: 202 len: 0 microversion: 2.1 time: 0.987241 May 10 17:49:17.574137 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 283/572] 10.222.0.60 () {60 vars in 1277 bytes} [Tue May 10 17:49:16 2022] POST /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb/action => generated 0 bytes in 990 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:49:17.585172 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0674bd85-6f9f-408a-9059-10600cb3d73c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:17.591302 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0674bd85-6f9f-408a-9059-10600cb3d73c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:17.619525 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0674bd85-6f9f-408a-9059-10600cb3d73c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:17.620840 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0674bd85-6f9f-408a-9059-10600cb3d73c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:17.622517 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0674bd85-6f9f-408a-9059-10600cb3d73c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:17.629562 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0674bd85-6f9f-408a-9059-10600cb3d73c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:17.738554 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7607187d-182c-40f5-a68a-be6ba812ace0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:17.758997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7607187d-182c-40f5-a68a-be6ba812ace0 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1319 microversion: 2.1 time: 0.338834 May 10 17:49:17.759687 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 290/573] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:17 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1319 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:17.765311 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-6127d487-b6e5-43b5-91de-b5ea030f9025 req-01bdac4a-fc9b-4237-93a1-479ae9f73401 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab1a9bd-b249-4f09-9264-87eb2a4878cb", "tag": "f023603c-ec90-40f8-beef-59e8c9f7f17f"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:49:17.781113 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-6127d487-b6e5-43b5-91de-b5ea030f9025 req-01bdac4a-fc9b-4237-93a1-479ae9f73401 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:17.781557 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-6127d487-b6e5-43b5-91de-b5ea030f9025 req-01bdac4a-fc9b-4237-93a1-479ae9f73401 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:17.814086 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-6127d487-b6e5-43b5-91de-b5ea030f9025 req-01bdac4a-fc9b-4237-93a1-479ae9f73401 service nova] Creating event network-changed:f023603c-ec90-40f8-beef-59e8c9f7f17f for instance 4ab1a9bd-b249-4f09-9264-87eb2a4878cb on hv-cinder-84130 May 10 17:49:17.829697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-6127d487-b6e5-43b5-91de-b5ea030f9025 req-01bdac4a-fc9b-4237-93a1-479ae9f73401 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065224 May 10 17:49:17.830480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 291/574] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:49:17.904114 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0674bd85-6f9f-408a-9059-10600cb3d73c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:17.914772 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0674bd85-6f9f-408a-9059-10600cb3d73c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1641 microversion: 2.1 time: 0.334329 May 10 17:49:17.916531 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 284/575] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:17 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1641 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:18.112976 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2abfae15-dc15-47b7-af7a-f1e62fce961e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:18.113974 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-2abfae15-dc15-47b7-af7a-f1e62fce961e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:18.122722 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2abfae15-dc15-47b7-af7a-f1e62fce961e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:18.123171 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2abfae15-dc15-47b7-af7a-f1e62fce961e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:18.124112 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2abfae15-dc15-47b7-af7a-f1e62fce961e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:18.124552 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2abfae15-dc15-47b7-af7a-f1e62fce961e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:18.270268 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-2abfae15-dc15-47b7-af7a-f1e62fce961e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:18.279727 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-2abfae15-dc15-47b7-af7a-f1e62fce961e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1366 microversion: 2.1 time: 0.171350 May 10 17:49:18.280472 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 292/576] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:18 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:18.426431 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2752bd75-b9ec-442f-9405-4b041b0a5d89 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:18.427049 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2752bd75-b9ec-442f-9405-4b041b0a5d89 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:18.434095 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2752bd75-b9ec-442f-9405-4b041b0a5d89 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:18.434806 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2752bd75-b9ec-442f-9405-4b041b0a5d89 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:18.435865 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2752bd75-b9ec-442f-9405-4b041b0a5d89 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:18.436305 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2752bd75-b9ec-442f-9405-4b041b0a5d89 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:18.593589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2752bd75-b9ec-442f-9405-4b041b0a5d89 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:18.604872 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2752bd75-b9ec-442f-9405-4b041b0a5d89 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:18.606772 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2752bd75-b9ec-442f-9405-4b041b0a5d89 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:18.608293 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2752bd75-b9ec-442f-9405-4b041b0a5d89 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1740 microversion: 2.20 time: 0.185686 May 10 17:49:18.608763 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 285/577] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:18 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:18.777483 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-153b2357-aa4e-496f-b4cb-2953c538a238 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:18.778111 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-153b2357-aa4e-496f-b4cb-2953c538a238 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:18.784549 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-153b2357-aa4e-496f-b4cb-2953c538a238 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:18.785305 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-153b2357-aa4e-496f-b4cb-2953c538a238 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:18.786100 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-153b2357-aa4e-496f-b4cb-2953c538a238 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:18.786548 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-153b2357-aa4e-496f-b4cb-2953c538a238 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:19.048038 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-153b2357-aa4e-496f-b4cb-2953c538a238 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:19.061064 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-153b2357-aa4e-496f-b4cb-2953c538a238 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1319 microversion: 2.1 time: 0.288240 May 10 17:49:19.074376 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 293/578] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:18 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:19.310127 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cfa69afc-755b-4efc-968a-f491911faf00 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:19.314911 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cfa69afc-755b-4efc-968a-f491911faf00 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:19.326755 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cfa69afc-755b-4efc-968a-f491911faf00 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:19.327682 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cfa69afc-755b-4efc-968a-f491911faf00 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:19.328785 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cfa69afc-755b-4efc-968a-f491911faf00 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:19.329468 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cfa69afc-755b-4efc-968a-f491911faf00 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:19.545293 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cfa69afc-755b-4efc-968a-f491911faf00 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:19.553865 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cfa69afc-755b-4efc-968a-f491911faf00 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1366 microversion: 2.1 time: 0.258601 May 10 17:49:19.557036 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 286/579] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:19 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:19.630850 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-46abd9c1-12d8-4570-a128-1732c4df5d43 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:19.632104 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-46abd9c1-12d8-4570-a128-1732c4df5d43 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:19.652235 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-46abd9c1-12d8-4570-a128-1732c4df5d43 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:19.653061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-46abd9c1-12d8-4570-a128-1732c4df5d43 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:19.654778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-46abd9c1-12d8-4570-a128-1732c4df5d43 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:19.656678 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-46abd9c1-12d8-4570-a128-1732c4df5d43 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:19.727932 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-9d88cf45-5c11-450a-a318-ec106c841bf4 req-395d8b5a-0818-49e2-9285-2270ad386864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4adcaebe-b2a0-4861-a874-24cbcdc8cd05", "name": "network-vif-plugged", "status": "completed", "tag": "4067eee9-a186-4e93-ba0a-31a799761eab"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:49:19.752457 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-9d88cf45-5c11-450a-a318-ec106c841bf4 req-395d8b5a-0818-49e2-9285-2270ad386864 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:19.760026 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-9d88cf45-5c11-450a-a318-ec106c841bf4 req-395d8b5a-0818-49e2-9285-2270ad386864 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:19.835276 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-9d88cf45-5c11-450a-a318-ec106c841bf4 req-395d8b5a-0818-49e2-9285-2270ad386864 service nova] Creating event network-vif-plugged:4067eee9-a186-4e93-ba0a-31a799761eab for instance 4adcaebe-b2a0-4861-a874-24cbcdc8cd05 on hv-cinder-84130 May 10 17:49:19.854227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-9d88cf45-5c11-450a-a318-ec106c841bf4 req-395d8b5a-0818-49e2-9285-2270ad386864 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130920 May 10 17:49:19.855471 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 287/580] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:49:19.910602 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-46abd9c1-12d8-4570-a128-1732c4df5d43 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:19.926651 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-46abd9c1-12d8-4570-a128-1732c4df5d43 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:19.929741 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-46abd9c1-12d8-4570-a128-1732c4df5d43 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:19.933983 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-46abd9c1-12d8-4570-a128-1732c4df5d43 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1740 microversion: 2.20 time: 0.308272 May 10 17:49:19.953344 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 294/581] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:19 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1740 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:49:20.080510 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e29ccfed-eb84-454e-8b40-d41446949900 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:20.081563 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e29ccfed-eb84-454e-8b40-d41446949900 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:20.094529 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e29ccfed-eb84-454e-8b40-d41446949900 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:20.100104 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e29ccfed-eb84-454e-8b40-d41446949900 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:20.100954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e29ccfed-eb84-454e-8b40-d41446949900 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:20.103014 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e29ccfed-eb84-454e-8b40-d41446949900 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:20.505190 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e29ccfed-eb84-454e-8b40-d41446949900 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:20.515981 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e29ccfed-eb84-454e-8b40-d41446949900 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1319 microversion: 2.1 time: 0.440446 May 10 17:49:20.517603 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 288/582] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:20 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1319 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:20.575870 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e50c6fba-7312-47c6-b80e-b30c90b297a5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:20.576482 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e50c6fba-7312-47c6-b80e-b30c90b297a5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:20.583841 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e50c6fba-7312-47c6-b80e-b30c90b297a5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:20.584628 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e50c6fba-7312-47c6-b80e-b30c90b297a5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:20.586625 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e50c6fba-7312-47c6-b80e-b30c90b297a5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:20.586986 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e50c6fba-7312-47c6-b80e-b30c90b297a5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:20.775636 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e50c6fba-7312-47c6-b80e-b30c90b297a5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:20.786965 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e50c6fba-7312-47c6-b80e-b30c90b297a5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1557 microversion: 2.1 time: 0.215446 May 10 17:49:20.787712 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 295/583] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:20 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:20.806576 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0013673b-8614-4ccf-81b3-de1118e24842 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:20.807395 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0013673b-8614-4ccf-81b3-de1118e24842 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:20.819018 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0013673b-8614-4ccf-81b3-de1118e24842 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:20.819600 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0013673b-8614-4ccf-81b3-de1118e24842 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:20.820957 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0013673b-8614-4ccf-81b3-de1118e24842 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:20.821399 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0013673b-8614-4ccf-81b3-de1118e24842 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:20.970641 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-3634a44c-0691-4390-a852-d59799e851b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:20.972164 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-3634a44c-0691-4390-a852-d59799e851b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:20.974930 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0013673b-8614-4ccf-81b3-de1118e24842 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.172371 May 10 17:49:20.975497 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 289/584] 10.222.0.60 () {58 vars in 1274 bytes} [Tue May 10 17:49:20 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50/os-interface => generated 285 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:49:21.000695 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3634a44c-0691-4390-a852-d59799e851b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:21.001495 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3634a44c-0691-4390-a852-d59799e851b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:21.002841 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3634a44c-0691-4390-a852-d59799e851b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:21.003919 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3634a44c-0691-4390-a852-d59799e851b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:21.306777 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-3634a44c-0691-4390-a852-d59799e851b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:21.323285 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-3634a44c-0691-4390-a852-d59799e851b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:21.330150 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-3634a44c-0691-4390-a852-d59799e851b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:21.338773 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-3634a44c-0691-4390-a852-d59799e851b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1740 microversion: 2.20 time: 0.375241 May 10 17:49:21.339866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 296/585] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:20 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1740 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:21.536767 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-75e3fd3a-5794-4128-809d-96505ca0901d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:21.538315 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-75e3fd3a-5794-4128-809d-96505ca0901d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:21.549411 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-75e3fd3a-5794-4128-809d-96505ca0901d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:21.550307 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-75e3fd3a-5794-4128-809d-96505ca0901d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:21.551276 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-75e3fd3a-5794-4128-809d-96505ca0901d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:21.552537 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-75e3fd3a-5794-4128-809d-96505ca0901d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:22.151315 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-75e3fd3a-5794-4128-809d-96505ca0901d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:22.169674 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-75e3fd3a-5794-4128-809d-96505ca0901d tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1319 microversion: 2.1 time: 0.637544 May 10 17:49:22.188397 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 290/586] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:21 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1319 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:22.359402 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-895b4f86-dcc0-4e20-9a61-924c5b003f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:22.360094 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-895b4f86-dcc0-4e20-9a61-924c5b003f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:22.374903 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-895b4f86-dcc0-4e20-9a61-924c5b003f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:22.376950 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-895b4f86-dcc0-4e20-9a61-924c5b003f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:22.380413 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-895b4f86-dcc0-4e20-9a61-924c5b003f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:22.380966 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-895b4f86-dcc0-4e20-9a61-924c5b003f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:22.603445 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-895b4f86-dcc0-4e20-9a61-924c5b003f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:22.616510 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-895b4f86-dcc0-4e20-9a61-924c5b003f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:22.622396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-895b4f86-dcc0-4e20-9a61-924c5b003f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:22.636277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-895b4f86-dcc0-4e20-9a61-924c5b003f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1740 microversion: 2.20 time: 0.278685 May 10 17:49:22.639802 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 297/587] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:22 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1740 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:22.812425 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-3c5ea77a-1617-4c1f-9759-694bbd8badae req-a3779eb5-d080-435e-a7b3-20b6199ced8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab2c473c-6e44-4cb5-8ddb-128a2061ae50", "tag": "9eecfcd3-4266-44a2-966e-218d7a2c006e"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:49:22.826741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-3c5ea77a-1617-4c1f-9759-694bbd8badae req-a3779eb5-d080-435e-a7b3-20b6199ced8c service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:22.829927 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-3c5ea77a-1617-4c1f-9759-694bbd8badae req-a3779eb5-d080-435e-a7b3-20b6199ced8c service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:22.855715 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-3c5ea77a-1617-4c1f-9759-694bbd8badae req-a3779eb5-d080-435e-a7b3-20b6199ced8c service nova] Creating event network-changed:9eecfcd3-4266-44a2-966e-218d7a2c006e for instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 on hv-cinder-84130 May 10 17:49:22.866316 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-3c5ea77a-1617-4c1f-9759-694bbd8badae req-a3779eb5-d080-435e-a7b3-20b6199ced8c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057641 May 10 17:49:22.873291 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 291/588] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:49:23.207226 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-68562420-f766-4914-b697-e6a59e96a2e6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:23.210980 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-68562420-f766-4914-b697-e6a59e96a2e6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:23.226861 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-68562420-f766-4914-b697-e6a59e96a2e6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:23.227679 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-68562420-f766-4914-b697-e6a59e96a2e6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:23.228817 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-68562420-f766-4914-b697-e6a59e96a2e6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:23.229497 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-68562420-f766-4914-b697-e6a59e96a2e6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:23.614042 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-68562420-f766-4914-b697-e6a59e96a2e6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:23.627414 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-68562420-f766-4914-b697-e6a59e96a2e6 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1508 microversion: 2.1 time: 0.434220 May 10 17:49:23.647833 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 298/589] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:49:23 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1508 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:49:23.662999 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f5c4ddf6-c7d3-42a5-98e2-fd80573f343a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:23.664776 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4e36c2d3-ec87-4e3b-b248-42556e98c167 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97a02dcc-6eea-4a99-b86c-76e92371577c", "device": "/dev/sdb"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:49:23.665317 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f5c4ddf6-c7d3-42a5-98e2-fd80573f343a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:23.667571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4e36c2d3-ec87-4e3b-b248-42556e98c167 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:23.673941 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f5c4ddf6-c7d3-42a5-98e2-fd80573f343a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:23.674504 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f5c4ddf6-c7d3-42a5-98e2-fd80573f343a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:23.675342 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f5c4ddf6-c7d3-42a5-98e2-fd80573f343a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:23.675827 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f5c4ddf6-c7d3-42a5-98e2-fd80573f343a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:23.682024 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4e36c2d3-ec87-4e3b-b248-42556e98c167 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:23.682896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4e36c2d3-ec87-4e3b-b248-42556e98c167 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:23.683963 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4e36c2d3-ec87-4e3b-b248-42556e98c167 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:23.684671 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4e36c2d3-ec87-4e3b-b248-42556e98c167 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:24.022404 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f5c4ddf6-c7d3-42a5-98e2-fd80573f343a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:24.042328 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f5c4ddf6-c7d3-42a5-98e2-fd80573f343a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:24.046667 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f5c4ddf6-c7d3-42a5-98e2-fd80573f343a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:24.048223 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f5c4ddf6-c7d3-42a5-98e2-fd80573f343a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1740 microversion: 2.20 time: 0.393933 May 10 17:49:24.056874 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 299/590] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:23 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1740 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:24.189678 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4e36c2d3-ec87-4e3b-b248-42556e98c167 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "POST /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.535345 May 10 17:49:24.190659 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 292/591] 10.222.0.60 () {60 vars in 1322 bytes} [Tue May 10 17:49:23 2022] POST /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05/os-volume_attachments => generated 194 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:49:25.072599 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-6c7b6e52-c132-4458-b8e0-56335b3b1afa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:25.073411 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-6c7b6e52-c132-4458-b8e0-56335b3b1afa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:25.086680 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6c7b6e52-c132-4458-b8e0-56335b3b1afa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:25.088207 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6c7b6e52-c132-4458-b8e0-56335b3b1afa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:25.089624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6c7b6e52-c132-4458-b8e0-56335b3b1afa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:25.090497 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6c7b6e52-c132-4458-b8e0-56335b3b1afa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:25.278847 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6c7b6e52-c132-4458-b8e0-56335b3b1afa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:25.302430 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6c7b6e52-c132-4458-b8e0-56335b3b1afa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:25.318127 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6c7b6e52-c132-4458-b8e0-56335b3b1afa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:25.322567 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-6c7b6e52-c132-4458-b8e0-56335b3b1afa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1740 microversion: 2.20 time: 0.256067 May 10 17:49:25.334604 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 300/592] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:25 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1740 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:49:26.343051 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-788e6131-3fef-40f7-9ff7-25e00ea3e204 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:26.343787 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-788e6131-3fef-40f7-9ff7-25e00ea3e204 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:26.352813 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-788e6131-3fef-40f7-9ff7-25e00ea3e204 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:26.353194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-788e6131-3fef-40f7-9ff7-25e00ea3e204 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:26.353977 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-788e6131-3fef-40f7-9ff7-25e00ea3e204 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:26.354887 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-788e6131-3fef-40f7-9ff7-25e00ea3e204 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:26.528918 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-788e6131-3fef-40f7-9ff7-25e00ea3e204 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:26.543520 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-788e6131-3fef-40f7-9ff7-25e00ea3e204 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:26.546637 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-788e6131-3fef-40f7-9ff7-25e00ea3e204 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:26.548904 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-788e6131-3fef-40f7-9ff7-25e00ea3e204 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1740 microversion: 2.20 time: 0.210417 May 10 17:49:26.550634 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 293/593] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:26 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:27.570726 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-3babb900-5902-4016-a339-4c2dbd4683c2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:27.572842 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-3babb900-5902-4016-a339-4c2dbd4683c2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:27.580773 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3babb900-5902-4016-a339-4c2dbd4683c2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:27.580773 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3babb900-5902-4016-a339-4c2dbd4683c2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:27.581435 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3babb900-5902-4016-a339-4c2dbd4683c2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:27.582969 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3babb900-5902-4016-a339-4c2dbd4683c2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:27.800250 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-3babb900-5902-4016-a339-4c2dbd4683c2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:27.827121 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-3babb900-5902-4016-a339-4c2dbd4683c2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:27.830529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-3babb900-5902-4016-a339-4c2dbd4683c2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:27.840339 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-3babb900-5902-4016-a339-4c2dbd4683c2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1740 microversion: 2.20 time: 0.266632 May 10 17:49:27.843343 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 301/594] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:27 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1740 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:28.870695 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7a6c0346-a76b-4686-a777-b10b90d28db6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:28.871313 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7a6c0346-a76b-4686-a777-b10b90d28db6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:28.879920 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7a6c0346-a76b-4686-a777-b10b90d28db6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:28.880512 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7a6c0346-a76b-4686-a777-b10b90d28db6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:28.881628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7a6c0346-a76b-4686-a777-b10b90d28db6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:28.882912 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7a6c0346-a76b-4686-a777-b10b90d28db6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:29.053121 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7a6c0346-a76b-4686-a777-b10b90d28db6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:29.062606 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7a6c0346-a76b-4686-a777-b10b90d28db6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:29.064160 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7a6c0346-a76b-4686-a777-b10b90d28db6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:29.065353 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7a6c0346-a76b-4686-a777-b10b90d28db6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1740 microversion: 2.20 time: 0.198952 May 10 17:49:29.065923 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 294/595] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:28 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:49:30.084094 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-95bac85b-6aaa-43b0-af2c-3e73db4eec9d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:30.084721 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-95bac85b-6aaa-43b0-af2c-3e73db4eec9d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:30.092418 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-95bac85b-6aaa-43b0-af2c-3e73db4eec9d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:30.092869 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-95bac85b-6aaa-43b0-af2c-3e73db4eec9d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:30.093649 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-95bac85b-6aaa-43b0-af2c-3e73db4eec9d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:30.094088 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-95bac85b-6aaa-43b0-af2c-3e73db4eec9d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:30.276830 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-95bac85b-6aaa-43b0-af2c-3e73db4eec9d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:30.285054 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-95bac85b-6aaa-43b0-af2c-3e73db4eec9d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:30.286556 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-95bac85b-6aaa-43b0-af2c-3e73db4eec9d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:30.287760 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-95bac85b-6aaa-43b0-af2c-3e73db4eec9d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1722 microversion: 2.20 time: 0.207662 May 10 17:49:30.288962 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 302/596] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:30 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:31.308346 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-459908d8-d0dc-4b3d-93dc-adfb9b63729b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:31.308947 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-459908d8-d0dc-4b3d-93dc-adfb9b63729b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:31.315473 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-459908d8-d0dc-4b3d-93dc-adfb9b63729b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:31.315926 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-459908d8-d0dc-4b3d-93dc-adfb9b63729b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:31.316703 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-459908d8-d0dc-4b3d-93dc-adfb9b63729b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:31.317141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-459908d8-d0dc-4b3d-93dc-adfb9b63729b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:31.458371 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-459908d8-d0dc-4b3d-93dc-adfb9b63729b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:31.467641 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-459908d8-d0dc-4b3d-93dc-adfb9b63729b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:31.469154 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-459908d8-d0dc-4b3d-93dc-adfb9b63729b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:31.470340 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-459908d8-d0dc-4b3d-93dc-adfb9b63729b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1722 microversion: 2.20 time: 0.166676 May 10 17:49:31.470917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 295/597] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:31 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:32.489023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ef415e3c-6282-444e-9376-c51c22915148 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:32.489635 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ef415e3c-6282-444e-9376-c51c22915148 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:32.496907 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ef415e3c-6282-444e-9376-c51c22915148 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:32.497360 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ef415e3c-6282-444e-9376-c51c22915148 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:32.498132 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ef415e3c-6282-444e-9376-c51c22915148 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:32.498570 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ef415e3c-6282-444e-9376-c51c22915148 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:32.760551 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ef415e3c-6282-444e-9376-c51c22915148 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:32.769380 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ef415e3c-6282-444e-9376-c51c22915148 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:32.770890 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ef415e3c-6282-444e-9376-c51c22915148 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:32.772094 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ef415e3c-6282-444e-9376-c51c22915148 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1722 microversion: 2.20 time: 0.286992 May 10 17:49:32.783242 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 303/598] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:32 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1722 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:33.116079 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-a70f0e1d-0389-4b02-aff3-a7e4acd3b89a req-778b7d05-92f6-4a54-b40f-8c37fce586bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4006eed6-2338-46b7-9133-e5c3fdead35c", "name": "network-vif-unplugged", "status": "completed", "tag": "e697d9cb-ff2b-45a4-8326-f3219cdf4121"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:49:33.128201 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-a70f0e1d-0389-4b02-aff3-a7e4acd3b89a req-778b7d05-92f6-4a54-b40f-8c37fce586bb service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:33.129210 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-a70f0e1d-0389-4b02-aff3-a7e4acd3b89a req-778b7d05-92f6-4a54-b40f-8c37fce586bb service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:33.141949 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-a70f0e1d-0389-4b02-aff3-a7e4acd3b89a req-778b7d05-92f6-4a54-b40f-8c37fce586bb service nova] Creating event network-vif-unplugged:e697d9cb-ff2b-45a4-8326-f3219cdf4121 for instance 4006eed6-2338-46b7-9133-e5c3fdead35c on hv-cinder-84130 May 10 17:49:33.147221 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-a70f0e1d-0389-4b02-aff3-a7e4acd3b89a req-778b7d05-92f6-4a54-b40f-8c37fce586bb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034808 May 10 17:49:33.148552 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 296/599] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:49:33.790830 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-49737bdb-aad9-4266-9f2f-32ddee595856 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:33.792146 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-49737bdb-aad9-4266-9f2f-32ddee595856 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:33.799173 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-49737bdb-aad9-4266-9f2f-32ddee595856 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:33.799708 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-49737bdb-aad9-4266-9f2f-32ddee595856 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:33.800521 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-49737bdb-aad9-4266-9f2f-32ddee595856 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:33.801115 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-49737bdb-aad9-4266-9f2f-32ddee595856 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:34.012251 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-49737bdb-aad9-4266-9f2f-32ddee595856 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:34.021169 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-49737bdb-aad9-4266-9f2f-32ddee595856 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:34.023304 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-49737bdb-aad9-4266-9f2f-32ddee595856 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:34.024710 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-49737bdb-aad9-4266-9f2f-32ddee595856 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1722 microversion: 2.20 time: 0.238483 May 10 17:49:34.027889 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 304/600] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:33 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:35.044461 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8bcda51d-3123-4938-a678-565d98f2a2d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:35.045158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8bcda51d-3123-4938-a678-565d98f2a2d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:35.052110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8bcda51d-3123-4938-a678-565d98f2a2d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:35.052554 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8bcda51d-3123-4938-a678-565d98f2a2d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:35.053330 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8bcda51d-3123-4938-a678-565d98f2a2d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:35.053827 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8bcda51d-3123-4938-a678-565d98f2a2d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:35.262228 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8bcda51d-3123-4938-a678-565d98f2a2d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:35.270542 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8bcda51d-3123-4938-a678-565d98f2a2d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:35.272099 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8bcda51d-3123-4938-a678-565d98f2a2d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:35.273345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8bcda51d-3123-4938-a678-565d98f2a2d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1665 microversion: 2.20 time: 0.233683 May 10 17:49:35.273894 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 297/601] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:35 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1665 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:35.291229 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-405346e9-9294-4480-a41a-3a4aab2a51a7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1975070b-d0ce-40e8-9051-e9cb8df171af"}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:49:35.292401 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-405346e9-9294-4480-a41a-3a4aab2a51a7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:35.298920 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-405346e9-9294-4480-a41a-3a4aab2a51a7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:35.299387 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-405346e9-9294-4480-a41a-3a4aab2a51a7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:35.300161 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-405346e9-9294-4480-a41a-3a4aab2a51a7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:35.300596 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-405346e9-9294-4480-a41a-3a4aab2a51a7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:35.602272 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-405346e9-9294-4480-a41a-3a4aab2a51a7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "POST /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.315435 May 10 17:49:35.602892 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 305/602] 10.222.0.60 () {62 vars in 1363 bytes} [Tue May 10 17:49:35 2022] POST /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/os-volume_attachments => generated 188 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:49:35.720784 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b869565e-4988-4c37-9f62-5d244d91ea12 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:49:35.721351 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b869565e-4988-4c37-9f62-5d244d91ea12 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:35.728738 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b869565e-4988-4c37-9f62-5d244d91ea12 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:35.729199 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b869565e-4988-4c37-9f62-5d244d91ea12 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:35.730024 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b869565e-4988-4c37-9f62-5d244d91ea12 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:35.730470 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b869565e-4988-4c37-9f62-5d244d91ea12 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:35.892089 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b869565e-4988-4c37-9f62-5d244d91ea12 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "POST /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/action" status: 202 len: 0 microversion: 2.20 time: 0.175171 May 10 17:49:35.892706 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 298/603] 10.222.0.60 () {62 vars in 1318 bytes} [Tue May 10 17:49:35 2022] POST /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 17:49:35.902014 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7cb25e03-36bd-4907-9fb4-7de604b2775e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:35.902663 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7cb25e03-36bd-4907-9fb4-7de604b2775e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:35.909371 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7cb25e03-36bd-4907-9fb4-7de604b2775e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:35.909820 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7cb25e03-36bd-4907-9fb4-7de604b2775e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:35.910605 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7cb25e03-36bd-4907-9fb4-7de604b2775e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:35.911036 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7cb25e03-36bd-4907-9fb4-7de604b2775e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:36.061583 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7cb25e03-36bd-4907-9fb4-7de604b2775e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:36.071099 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7cb25e03-36bd-4907-9fb4-7de604b2775e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:36.073028 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7cb25e03-36bd-4907-9fb4-7de604b2775e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:36.074242 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7cb25e03-36bd-4907-9fb4-7de604b2775e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1751 microversion: 2.20 time: 0.176760 May 10 17:49:36.074816 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 306/604] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:35 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:37.093465 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b30d8a8d-b355-4c7e-9d4c-4e65dc6a0ac6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:37.094013 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b30d8a8d-b355-4c7e-9d4c-4e65dc6a0ac6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:37.101425 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b30d8a8d-b355-4c7e-9d4c-4e65dc6a0ac6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:37.101877 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b30d8a8d-b355-4c7e-9d4c-4e65dc6a0ac6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:37.102686 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b30d8a8d-b355-4c7e-9d4c-4e65dc6a0ac6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:37.103123 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b30d8a8d-b355-4c7e-9d4c-4e65dc6a0ac6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:37.234057 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b30d8a8d-b355-4c7e-9d4c-4e65dc6a0ac6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:37.242585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b30d8a8d-b355-4c7e-9d4c-4e65dc6a0ac6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:37.244148 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b30d8a8d-b355-4c7e-9d4c-4e65dc6a0ac6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:37.245327 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b30d8a8d-b355-4c7e-9d4c-4e65dc6a0ac6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1751 microversion: 2.20 time: 0.156615 May 10 17:49:37.245888 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 299/605] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:37 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:38.264220 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-25c7f3b3-0d85-4525-b7d0-1a4cfdb369d2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:38.264855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-25c7f3b3-0d85-4525-b7d0-1a4cfdb369d2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:38.271450 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-25c7f3b3-0d85-4525-b7d0-1a4cfdb369d2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:38.271904 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-25c7f3b3-0d85-4525-b7d0-1a4cfdb369d2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:38.272708 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-25c7f3b3-0d85-4525-b7d0-1a4cfdb369d2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:38.273141 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-25c7f3b3-0d85-4525-b7d0-1a4cfdb369d2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:38.412611 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-25c7f3b3-0d85-4525-b7d0-1a4cfdb369d2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:38.422222 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-25c7f3b3-0d85-4525-b7d0-1a4cfdb369d2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:38.423752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-25c7f3b3-0d85-4525-b7d0-1a4cfdb369d2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:38.424940 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-25c7f3b3-0d85-4525-b7d0-1a4cfdb369d2 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1751 microversion: 2.20 time: 0.164669 May 10 17:49:38.425510 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 307/606] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:38 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:39.447124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-eb929635-5646-43be-8c60-f51c6da5e0cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:39.448193 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-eb929635-5646-43be-8c60-f51c6da5e0cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:39.455050 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-eb929635-5646-43be-8c60-f51c6da5e0cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:39.455699 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-eb929635-5646-43be-8c60-f51c6da5e0cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:39.456488 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-eb929635-5646-43be-8c60-f51c6da5e0cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:39.456934 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-eb929635-5646-43be-8c60-f51c6da5e0cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:39.608858 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-eb929635-5646-43be-8c60-f51c6da5e0cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:39.620394 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-eb929635-5646-43be-8c60-f51c6da5e0cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:39.621884 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-eb929635-5646-43be-8c60-f51c6da5e0cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:39.623051 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-eb929635-5646-43be-8c60-f51c6da5e0cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1751 microversion: 2.20 time: 0.181211 May 10 17:49:39.623650 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 300/607] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:39 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:40.643598 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-badd3376-ec6b-4730-8c95-01462bf32067 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:40.644132 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-badd3376-ec6b-4730-8c95-01462bf32067 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:40.651061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-badd3376-ec6b-4730-8c95-01462bf32067 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:40.651543 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-badd3376-ec6b-4730-8c95-01462bf32067 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:40.652310 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-badd3376-ec6b-4730-8c95-01462bf32067 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:40.652747 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-badd3376-ec6b-4730-8c95-01462bf32067 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:40.789469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-badd3376-ec6b-4730-8c95-01462bf32067 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:40.798124 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-badd3376-ec6b-4730-8c95-01462bf32067 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:40.799654 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-badd3376-ec6b-4730-8c95-01462bf32067 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:40.800832 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-badd3376-ec6b-4730-8c95-01462bf32067 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1753 microversion: 2.20 time: 0.161582 May 10 17:49:40.801403 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 308/608] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:40 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:41.820950 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7d288a8f-6bf4-4146-a361-d73e2efae464 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:41.821598 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7d288a8f-6bf4-4146-a361-d73e2efae464 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:41.828905 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d288a8f-6bf4-4146-a361-d73e2efae464 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:41.829519 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d288a8f-6bf4-4146-a361-d73e2efae464 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:41.830331 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d288a8f-6bf4-4146-a361-d73e2efae464 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:41.831518 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7d288a8f-6bf4-4146-a361-d73e2efae464 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:42.009288 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7d288a8f-6bf4-4146-a361-d73e2efae464 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:42.018422 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7d288a8f-6bf4-4146-a361-d73e2efae464 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:42.020010 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7d288a8f-6bf4-4146-a361-d73e2efae464 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:42.021207 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7d288a8f-6bf4-4146-a361-d73e2efae464 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1753 microversion: 2.20 time: 0.204780 May 10 17:49:42.021793 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 301/609] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:41 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1753 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:43.043818 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-42ad21ad-2394-4cd7-b89d-8fb9b5373f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:43.044466 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-42ad21ad-2394-4cd7-b89d-8fb9b5373f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:43.050926 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-42ad21ad-2394-4cd7-b89d-8fb9b5373f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:43.051404 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-42ad21ad-2394-4cd7-b89d-8fb9b5373f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:43.052182 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-42ad21ad-2394-4cd7-b89d-8fb9b5373f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:43.052624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-42ad21ad-2394-4cd7-b89d-8fb9b5373f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:43.186469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-42ad21ad-2394-4cd7-b89d-8fb9b5373f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:43.194973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-42ad21ad-2394-4cd7-b89d-8fb9b5373f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:43.196493 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-42ad21ad-2394-4cd7-b89d-8fb9b5373f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:43.197950 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-42ad21ad-2394-4cd7-b89d-8fb9b5373f50 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.159945 May 10 17:49:43.198505 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 309/610] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:43 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:44.218266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-fe02945f-3e2c-4156-acbf-af2600ea68f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:44.218860 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-fe02945f-3e2c-4156-acbf-af2600ea68f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:44.226062 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fe02945f-3e2c-4156-acbf-af2600ea68f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:44.226837 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fe02945f-3e2c-4156-acbf-af2600ea68f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:44.227910 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fe02945f-3e2c-4156-acbf-af2600ea68f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:44.228555 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fe02945f-3e2c-4156-acbf-af2600ea68f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:44.374679 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fe02945f-3e2c-4156-acbf-af2600ea68f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:44.384304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fe02945f-3e2c-4156-acbf-af2600ea68f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:44.385794 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fe02945f-3e2c-4156-acbf-af2600ea68f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:44.386963 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-fe02945f-3e2c-4156-acbf-af2600ea68f4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.172816 May 10 17:49:44.387549 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 302/611] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:44 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:45.521168 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-51e4a515-0046-494e-b865-756543b57323 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:45.521776 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-51e4a515-0046-494e-b865-756543b57323 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:45.528410 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-51e4a515-0046-494e-b865-756543b57323 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:45.528848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-51e4a515-0046-494e-b865-756543b57323 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:45.529604 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-51e4a515-0046-494e-b865-756543b57323 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:45.530035 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-51e4a515-0046-494e-b865-756543b57323 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:45.659610 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-51e4a515-0046-494e-b865-756543b57323 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:45.668953 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-51e4a515-0046-494e-b865-756543b57323 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:45.670496 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-51e4a515-0046-494e-b865-756543b57323 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:45.671848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-51e4a515-0046-494e-b865-756543b57323 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.269931 May 10 17:49:45.672416 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 310/612] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:45 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:46.693164 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-fe5158fa-037f-4251-ad3b-5e64ade43e78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:46.693772 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-fe5158fa-037f-4251-ad3b-5e64ade43e78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:46.706099 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fe5158fa-037f-4251-ad3b-5e64ade43e78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:46.706587 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fe5158fa-037f-4251-ad3b-5e64ade43e78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:46.707423 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fe5158fa-037f-4251-ad3b-5e64ade43e78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:46.707863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fe5158fa-037f-4251-ad3b-5e64ade43e78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:46.864769 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fe5158fa-037f-4251-ad3b-5e64ade43e78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:46.874668 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fe5158fa-037f-4251-ad3b-5e64ade43e78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:46.876763 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fe5158fa-037f-4251-ad3b-5e64ade43e78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:46.878171 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-fe5158fa-037f-4251-ad3b-5e64ade43e78 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.190813 May 10 17:49:46.878759 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 303/613] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:46 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:47.898629 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1f374a97-2eb1-4e75-8cac-ef3c324dd9b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:47.899180 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-1f374a97-2eb1-4e75-8cac-ef3c324dd9b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:47.906023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1f374a97-2eb1-4e75-8cac-ef3c324dd9b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:47.906465 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1f374a97-2eb1-4e75-8cac-ef3c324dd9b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:47.907496 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1f374a97-2eb1-4e75-8cac-ef3c324dd9b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:47.908102 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1f374a97-2eb1-4e75-8cac-ef3c324dd9b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:48.058965 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1f374a97-2eb1-4e75-8cac-ef3c324dd9b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:48.067766 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1f374a97-2eb1-4e75-8cac-ef3c324dd9b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:48.069921 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1f374a97-2eb1-4e75-8cac-ef3c324dd9b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:48.071280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-1f374a97-2eb1-4e75-8cac-ef3c324dd9b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.177660 May 10 17:49:48.072137 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 311/614] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:47 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:49.090787 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b154a52d-fe24-45ff-b2e3-38b629985dba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:49.091326 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b154a52d-fe24-45ff-b2e3-38b629985dba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:49.097666 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b154a52d-fe24-45ff-b2e3-38b629985dba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:49.098118 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b154a52d-fe24-45ff-b2e3-38b629985dba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:49.098884 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b154a52d-fe24-45ff-b2e3-38b629985dba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:49.099323 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b154a52d-fe24-45ff-b2e3-38b629985dba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:49.243278 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b154a52d-fe24-45ff-b2e3-38b629985dba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:49.253791 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b154a52d-fe24-45ff-b2e3-38b629985dba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:49.256067 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b154a52d-fe24-45ff-b2e3-38b629985dba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:49.258271 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b154a52d-fe24-45ff-b2e3-38b629985dba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.171245 May 10 17:49:49.258847 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 304/615] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:49 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:50.276752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ead8a947-ec07-46da-9268-d3dbde323747 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:50.277430 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ead8a947-ec07-46da-9268-d3dbde323747 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:50.284433 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ead8a947-ec07-46da-9268-d3dbde323747 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:50.284883 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ead8a947-ec07-46da-9268-d3dbde323747 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:50.285765 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ead8a947-ec07-46da-9268-d3dbde323747 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:50.286252 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ead8a947-ec07-46da-9268-d3dbde323747 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:50.432204 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ead8a947-ec07-46da-9268-d3dbde323747 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:50.440705 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ead8a947-ec07-46da-9268-d3dbde323747 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:50.442277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ead8a947-ec07-46da-9268-d3dbde323747 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:50.443478 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ead8a947-ec07-46da-9268-d3dbde323747 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.170884 May 10 17:49:50.444749 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 312/616] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:50 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:50.987180 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2e786dc5-58dd-4d1e-b49d-8164efa5329c tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:50.987790 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2e786dc5-58dd-4d1e-b49d-8164efa5329c tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:50.995766 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e786dc5-58dd-4d1e-b49d-8164efa5329c tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:50.996383 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e786dc5-58dd-4d1e-b49d-8164efa5329c tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:50.997339 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e786dc5-58dd-4d1e-b49d-8164efa5329c tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:50.997787 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e786dc5-58dd-4d1e-b49d-8164efa5329c tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:51.135377 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-2e786dc5-58dd-4d1e-b49d-8164efa5329c tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lazy-loading 'services' on Instance uuid 4adcaebe-b2a0-4861-a874-24cbcdc8cd05 {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:49:51.262933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2e786dc5-58dd-4d1e-b49d-8164efa5329c tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05/os-volume_attachments/97a02dcc-6eea-4a99-b86c-76e92371577c" status: 202 len: 0 microversion: 2.1 time: 0.279930 May 10 17:49:51.263562 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 305/617] 10.222.0.60 () {58 vars in 1415 bytes} [Tue May 10 17:49:50 2022] DELETE /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05/os-volume_attachments/97a02dcc-6eea-4a99-b86c-76e92371577c => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:49:51.463227 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ce008019-582c-4baa-9fbf-a29c87f2623c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:51.463858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ce008019-582c-4baa-9fbf-a29c87f2623c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:51.470188 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ce008019-582c-4baa-9fbf-a29c87f2623c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:51.470637 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ce008019-582c-4baa-9fbf-a29c87f2623c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:51.471421 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ce008019-582c-4baa-9fbf-a29c87f2623c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:51.471863 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ce008019-582c-4baa-9fbf-a29c87f2623c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:51.613327 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ce008019-582c-4baa-9fbf-a29c87f2623c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:51.624057 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ce008019-582c-4baa-9fbf-a29c87f2623c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:51.625655 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ce008019-582c-4baa-9fbf-a29c87f2623c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:51.626904 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ce008019-582c-4baa-9fbf-a29c87f2623c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.167659 May 10 17:49:51.627479 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 313/618] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:51 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:52.652423 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a352761a-95ef-4afd-877a-fda0f9e2cf06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:52.653079 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a352761a-95ef-4afd-877a-fda0f9e2cf06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:52.660665 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a352761a-95ef-4afd-877a-fda0f9e2cf06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:52.661119 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a352761a-95ef-4afd-877a-fda0f9e2cf06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:52.661900 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a352761a-95ef-4afd-877a-fda0f9e2cf06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:52.662339 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a352761a-95ef-4afd-877a-fda0f9e2cf06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:52.801936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a352761a-95ef-4afd-877a-fda0f9e2cf06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:52.812398 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a352761a-95ef-4afd-877a-fda0f9e2cf06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:52.814686 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a352761a-95ef-4afd-877a-fda0f9e2cf06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:52.816481 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a352761a-95ef-4afd-877a-fda0f9e2cf06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.169983 May 10 17:49:52.817232 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 306/619] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:52 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:53.838828 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b2b6ba76-8f38-4274-a0db-02120d44a9e1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:53.839545 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-b2b6ba76-8f38-4274-a0db-02120d44a9e1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:53.846353 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b2b6ba76-8f38-4274-a0db-02120d44a9e1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:53.846804 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b2b6ba76-8f38-4274-a0db-02120d44a9e1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:53.847609 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b2b6ba76-8f38-4274-a0db-02120d44a9e1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:53.848049 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b2b6ba76-8f38-4274-a0db-02120d44a9e1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:53.991986 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b2b6ba76-8f38-4274-a0db-02120d44a9e1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:54.001192 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b2b6ba76-8f38-4274-a0db-02120d44a9e1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:54.002722 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b2b6ba76-8f38-4274-a0db-02120d44a9e1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:54.003956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b2b6ba76-8f38-4274-a0db-02120d44a9e1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.171149 May 10 17:49:54.004525 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 314/620] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:53 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:49:55.023434 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3f83f8b3-8812-4075-b362-03382a497ce1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:55.024659 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3f83f8b3-8812-4075-b362-03382a497ce1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:55.030766 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3f83f8b3-8812-4075-b362-03382a497ce1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:55.031271 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3f83f8b3-8812-4075-b362-03382a497ce1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:55.032241 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3f83f8b3-8812-4075-b362-03382a497ce1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:55.032687 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3f83f8b3-8812-4075-b362-03382a497ce1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:55.185390 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3f83f8b3-8812-4075-b362-03382a497ce1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:55.194942 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3f83f8b3-8812-4075-b362-03382a497ce1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:55.196512 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3f83f8b3-8812-4075-b362-03382a497ce1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:55.197993 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3f83f8b3-8812-4075-b362-03382a497ce1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.179065 May 10 17:49:55.208480 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 307/621] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:55 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:56.217689 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-51c5a036-1166-49f5-b794-62bb373bd57a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:56.218436 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-51c5a036-1166-49f5-b794-62bb373bd57a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:56.226178 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-51c5a036-1166-49f5-b794-62bb373bd57a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:56.226830 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-51c5a036-1166-49f5-b794-62bb373bd57a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:56.227723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-51c5a036-1166-49f5-b794-62bb373bd57a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:56.228235 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-51c5a036-1166-49f5-b794-62bb373bd57a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:56.382498 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-51c5a036-1166-49f5-b794-62bb373bd57a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:56.391491 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-51c5a036-1166-49f5-b794-62bb373bd57a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:56.393081 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-51c5a036-1166-49f5-b794-62bb373bd57a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:56.394400 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-51c5a036-1166-49f5-b794-62bb373bd57a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.181570 May 10 17:49:56.395170 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 315/622] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:56 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:57.413173 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b4db2389-373a-4981-b2fc-15517abc108c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:57.413972 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b4db2389-373a-4981-b2fc-15517abc108c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:57.420563 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b4db2389-373a-4981-b2fc-15517abc108c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:57.421076 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b4db2389-373a-4981-b2fc-15517abc108c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:57.421826 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b4db2389-373a-4981-b2fc-15517abc108c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:57.422267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b4db2389-373a-4981-b2fc-15517abc108c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:57.567988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b4db2389-373a-4981-b2fc-15517abc108c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:57.583640 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b4db2389-373a-4981-b2fc-15517abc108c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:57.585916 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b4db2389-373a-4981-b2fc-15517abc108c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:57.587657 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b4db2389-373a-4981-b2fc-15517abc108c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.179014 May 10 17:49:57.592992 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 308/623] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:57 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:58.605735 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-82781e1d-226b-4afa-a2d3-7f125d319d7d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:58.607141 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-82781e1d-226b-4afa-a2d3-7f125d319d7d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:58.613920 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-82781e1d-226b-4afa-a2d3-7f125d319d7d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:58.614453 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-82781e1d-226b-4afa-a2d3-7f125d319d7d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:58.615326 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-82781e1d-226b-4afa-a2d3-7f125d319d7d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:58.616527 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-82781e1d-226b-4afa-a2d3-7f125d319d7d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:58.759438 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-82781e1d-226b-4afa-a2d3-7f125d319d7d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:58.768149 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-82781e1d-226b-4afa-a2d3-7f125d319d7d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:58.769684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-82781e1d-226b-4afa-a2d3-7f125d319d7d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:58.770851 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-82781e1d-226b-4afa-a2d3-7f125d319d7d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.169052 May 10 17:49:58.771435 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 316/624] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:58 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:49:59.789637 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-61ee6312-1b1f-48ed-b8ee-5900915384b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:49:59.790176 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-61ee6312-1b1f-48ed-b8ee-5900915384b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:49:59.796312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61ee6312-1b1f-48ed-b8ee-5900915384b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:59.796900 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61ee6312-1b1f-48ed-b8ee-5900915384b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:59.797669 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61ee6312-1b1f-48ed-b8ee-5900915384b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:49:59.798110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-61ee6312-1b1f-48ed-b8ee-5900915384b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:49:59.930950 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-61ee6312-1b1f-48ed-b8ee-5900915384b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:59.939563 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-61ee6312-1b1f-48ed-b8ee-5900915384b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:59.941129 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-61ee6312-1b1f-48ed-b8ee-5900915384b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:49:59.942290 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-61ee6312-1b1f-48ed-b8ee-5900915384b7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.157350 May 10 17:49:59.942864 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 309/625] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:49:59 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:00.961412 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-950b1817-4169-4332-be2a-8546ba3e26b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:00.961994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-950b1817-4169-4332-be2a-8546ba3e26b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:00.968531 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-950b1817-4169-4332-be2a-8546ba3e26b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:00.968978 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-950b1817-4169-4332-be2a-8546ba3e26b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:00.969747 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-950b1817-4169-4332-be2a-8546ba3e26b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:00.970181 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-950b1817-4169-4332-be2a-8546ba3e26b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:01.107408 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-950b1817-4169-4332-be2a-8546ba3e26b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:01.117316 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-950b1817-4169-4332-be2a-8546ba3e26b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:01.118838 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-950b1817-4169-4332-be2a-8546ba3e26b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:01.120050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-950b1817-4169-4332-be2a-8546ba3e26b5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.162667 May 10 17:50:01.120611 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 317/626] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:00 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:02.138727 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-eabd7b23-8709-45b8-8709-ad6b1d19eda1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:02.139258 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-eabd7b23-8709-45b8-8709-ad6b1d19eda1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:02.145639 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-eabd7b23-8709-45b8-8709-ad6b1d19eda1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:02.146082 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-eabd7b23-8709-45b8-8709-ad6b1d19eda1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:02.147520 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-eabd7b23-8709-45b8-8709-ad6b1d19eda1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:02.148142 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-eabd7b23-8709-45b8-8709-ad6b1d19eda1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:02.281860 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-eabd7b23-8709-45b8-8709-ad6b1d19eda1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:02.291229 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-eabd7b23-8709-45b8-8709-ad6b1d19eda1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:02.292739 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-eabd7b23-8709-45b8-8709-ad6b1d19eda1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:02.293906 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-eabd7b23-8709-45b8-8709-ad6b1d19eda1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.159189 May 10 17:50:02.294474 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 310/627] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:02 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:03.312878 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-62507e36-67cd-48fb-9a51-3126ba1cac8e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:03.313461 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-62507e36-67cd-48fb-9a51-3126ba1cac8e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:03.320247 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-62507e36-67cd-48fb-9a51-3126ba1cac8e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:03.320693 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-62507e36-67cd-48fb-9a51-3126ba1cac8e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:03.321484 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-62507e36-67cd-48fb-9a51-3126ba1cac8e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:03.322224 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-62507e36-67cd-48fb-9a51-3126ba1cac8e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:03.456485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-62507e36-67cd-48fb-9a51-3126ba1cac8e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:03.465059 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-62507e36-67cd-48fb-9a51-3126ba1cac8e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:03.466549 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-62507e36-67cd-48fb-9a51-3126ba1cac8e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:03.467733 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-62507e36-67cd-48fb-9a51-3126ba1cac8e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.158986 May 10 17:50:03.468295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 318/628] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:03 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:04.486696 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-643044d0-d695-4636-afa6-5cb6738c73aa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:04.488322 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-643044d0-d695-4636-afa6-5cb6738c73aa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:04.496113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-643044d0-d695-4636-afa6-5cb6738c73aa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:04.496561 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-643044d0-d695-4636-afa6-5cb6738c73aa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:04.497340 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-643044d0-d695-4636-afa6-5cb6738c73aa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:04.497773 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-643044d0-d695-4636-afa6-5cb6738c73aa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:04.642626 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-643044d0-d695-4636-afa6-5cb6738c73aa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:04.651232 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-643044d0-d695-4636-afa6-5cb6738c73aa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:04.652768 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-643044d0-d695-4636-afa6-5cb6738c73aa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:04.653928 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-643044d0-d695-4636-afa6-5cb6738c73aa tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.171203 May 10 17:50:04.654498 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 311/629] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:04 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:50:05.672542 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-13c4c840-4de6-4710-a644-2cf92e0dd1b1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:05.673157 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-13c4c840-4de6-4710-a644-2cf92e0dd1b1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:05.680409 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-13c4c840-4de6-4710-a644-2cf92e0dd1b1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:05.680863 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-13c4c840-4de6-4710-a644-2cf92e0dd1b1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:05.681648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-13c4c840-4de6-4710-a644-2cf92e0dd1b1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:05.682085 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-13c4c840-4de6-4710-a644-2cf92e0dd1b1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:05.814297 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-13c4c840-4de6-4710-a644-2cf92e0dd1b1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:05.825371 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-13c4c840-4de6-4710-a644-2cf92e0dd1b1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:05.827295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-13c4c840-4de6-4710-a644-2cf92e0dd1b1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:05.827964 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-13c4c840-4de6-4710-a644-2cf92e0dd1b1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.159420 May 10 17:50:05.828567 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 319/630] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:05 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:06.118172 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4e136f3f-8967-4c2e-87d5-45e02a451d77 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:06.118747 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4e136f3f-8967-4c2e-87d5-45e02a451d77 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:06.125118 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4e136f3f-8967-4c2e-87d5-45e02a451d77 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:06.125569 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4e136f3f-8967-4c2e-87d5-45e02a451d77 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:06.126343 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4e136f3f-8967-4c2e-87d5-45e02a451d77 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:06.126781 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4e136f3f-8967-4c2e-87d5-45e02a451d77 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:06.152994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4e136f3f-8967-4c2e-87d5-45e02a451d77 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:50:06.233509 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4e136f3f-8967-4c2e-87d5-45e02a451d77 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 204 len: 0 microversion: 2.1 time: 0.118925 May 10 17:50:06.234132 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 312/631] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:50:06 2022] DELETE /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:50:06.242572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-d4a7e1f3-0ab2-45f8-8695-c100c5cda4f5 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:06.243287 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-d4a7e1f3-0ab2-45f8-8695-c100c5cda4f5 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:06.250085 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d4a7e1f3-0ab2-45f8-8695-c100c5cda4f5 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:06.250542 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d4a7e1f3-0ab2-45f8-8695-c100c5cda4f5 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:06.251314 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d4a7e1f3-0ab2-45f8-8695-c100c5cda4f5 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:06.251775 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d4a7e1f3-0ab2-45f8-8695-c100c5cda4f5 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:06.387965 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-d4a7e1f3-0ab2-45f8-8695-c100c5cda4f5 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:06.395288 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-d4a7e1f3-0ab2-45f8-8695-c100c5cda4f5 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1514 microversion: 2.1 time: 0.156670 May 10 17:50:06.395911 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 320/632] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:06 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:06.847541 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b8843aa6-22c6-4f4b-a1d6-1e9188672a77 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:06.848232 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b8843aa6-22c6-4f4b-a1d6-1e9188672a77 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:06.854419 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b8843aa6-22c6-4f4b-a1d6-1e9188672a77 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:06.854867 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b8843aa6-22c6-4f4b-a1d6-1e9188672a77 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:06.855657 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b8843aa6-22c6-4f4b-a1d6-1e9188672a77 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:06.856202 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b8843aa6-22c6-4f4b-a1d6-1e9188672a77 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:06.981958 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b8843aa6-22c6-4f4b-a1d6-1e9188672a77 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:06.990236 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b8843aa6-22c6-4f4b-a1d6-1e9188672a77 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:06.992560 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b8843aa6-22c6-4f4b-a1d6-1e9188672a77 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:06.993725 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b8843aa6-22c6-4f4b-a1d6-1e9188672a77 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.150476 May 10 17:50:06.994293 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 313/633] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:06 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:07.414140 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-56601e21-238b-45f7-af05-39c98cc14121 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:07.414733 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-56601e21-238b-45f7-af05-39c98cc14121 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:07.421340 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-56601e21-238b-45f7-af05-39c98cc14121 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:07.421795 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-56601e21-238b-45f7-af05-39c98cc14121 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:07.422616 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-56601e21-238b-45f7-af05-39c98cc14121 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:07.423033 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-56601e21-238b-45f7-af05-39c98cc14121 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:07.559704 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-56601e21-238b-45f7-af05-39c98cc14121 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:07.566898 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-56601e21-238b-45f7-af05-39c98cc14121 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1514 microversion: 2.1 time: 0.157851 May 10 17:50:07.567486 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 321/634] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:07 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:08.012022 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e2146bed-6442-4ecf-939c-a11c9d8fae03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:08.012628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e2146bed-6442-4ecf-939c-a11c9d8fae03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:08.018930 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e2146bed-6442-4ecf-939c-a11c9d8fae03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:08.019407 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e2146bed-6442-4ecf-939c-a11c9d8fae03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:08.020173 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e2146bed-6442-4ecf-939c-a11c9d8fae03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:08.020608 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e2146bed-6442-4ecf-939c-a11c9d8fae03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:08.147849 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e2146bed-6442-4ecf-939c-a11c9d8fae03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:08.156170 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e2146bed-6442-4ecf-939c-a11c9d8fae03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:08.157653 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e2146bed-6442-4ecf-939c-a11c9d8fae03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:08.158807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e2146bed-6442-4ecf-939c-a11c9d8fae03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.150834 May 10 17:50:08.159381 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 314/635] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:08 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:08.583787 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-775be851-eb39-4a2e-99e7-9f779c92ecb3 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:08.584389 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-775be851-eb39-4a2e-99e7-9f779c92ecb3 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:08.591249 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-775be851-eb39-4a2e-99e7-9f779c92ecb3 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:08.591814 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-775be851-eb39-4a2e-99e7-9f779c92ecb3 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:08.592866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-775be851-eb39-4a2e-99e7-9f779c92ecb3 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:08.593378 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-775be851-eb39-4a2e-99e7-9f779c92ecb3 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:08.818270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-775be851-eb39-4a2e-99e7-9f779c92ecb3 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:08.825947 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-775be851-eb39-4a2e-99e7-9f779c92ecb3 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1514 microversion: 2.1 time: 0.246144 May 10 17:50:08.826521 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 322/636] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:08 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1514 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:09.177131 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2e2402a5-7b87-46df-b8bc-6b03b65bb133 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:09.177873 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2e2402a5-7b87-46df-b8bc-6b03b65bb133 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:09.184879 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e2402a5-7b87-46df-b8bc-6b03b65bb133 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:09.185331 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e2402a5-7b87-46df-b8bc-6b03b65bb133 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:09.186217 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e2402a5-7b87-46df-b8bc-6b03b65bb133 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:09.186740 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e2402a5-7b87-46df-b8bc-6b03b65bb133 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:09.404619 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2e2402a5-7b87-46df-b8bc-6b03b65bb133 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:09.408852 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-3a01f4e0-3ac2-4285-a20f-ea6bd3b15a75 req-da8081b6-fdd6-4133-bac3-77c66ab01757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4adcaebe-b2a0-4861-a874-24cbcdc8cd05", "name": "network-vif-deleted", "tag": "4067eee9-a186-4e93-ba0a-31a799761eab"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:50:09.413500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2e2402a5-7b87-46df-b8bc-6b03b65bb133 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:09.415807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2e2402a5-7b87-46df-b8bc-6b03b65bb133 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:09.417248 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2e2402a5-7b87-46df-b8bc-6b03b65bb133 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.244159 May 10 17:50:09.417388 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-3a01f4e0-3ac2-4285-a20f-ea6bd3b15a75 req-da8081b6-fdd6-4133-bac3-77c66ab01757 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:09.417820 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-3a01f4e0-3ac2-4285-a20f-ea6bd3b15a75 req-da8081b6-fdd6-4133-bac3-77c66ab01757 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:09.419407 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 315/637] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:09 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:09.430249 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-3a01f4e0-3ac2-4285-a20f-ea6bd3b15a75 req-da8081b6-fdd6-4133-bac3-77c66ab01757 service nova] Creating event network-vif-deleted:4067eee9-a186-4e93-ba0a-31a799761eab for instance 4adcaebe-b2a0-4861-a874-24cbcdc8cd05 on hv-cinder-84130 May 10 17:50:09.435487 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-3a01f4e0-3ac2-4285-a20f-ea6bd3b15a75 req-da8081b6-fdd6-4133-bac3-77c66ab01757 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092194 May 10 17:50:09.436106 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 323/638] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:50:09.842072 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-76c7bf53-04ce-4e12-beb3-c6aad59f7de8 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:09.842699 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-76c7bf53-04ce-4e12-beb3-c6aad59f7de8 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:09.848746 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-76c7bf53-04ce-4e12-beb3-c6aad59f7de8 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:09.849195 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-76c7bf53-04ce-4e12-beb3-c6aad59f7de8 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:09.849954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-76c7bf53-04ce-4e12-beb3-c6aad59f7de8 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:09.850387 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-76c7bf53-04ce-4e12-beb3-c6aad59f7de8 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:09.891945 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-76c7bf53-04ce-4e12-beb3-c6aad59f7de8 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:09.892389 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-76c7bf53-04ce-4e12-beb3-c6aad59f7de8 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:09.892842 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-76c7bf53-04ce-4e12-beb3-c6aad59f7de8 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lazy-loading 'fault' on Instance uuid 4adcaebe-b2a0-4861-a874-24cbcdc8cd05 {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:50:09.936143 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-76c7bf53-04ce-4e12-beb3-c6aad59f7de8 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:09.944316 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-76c7bf53-04ce-4e12-beb3-c6aad59f7de8 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1309 microversion: 2.1 time: 0.106016 May 10 17:50:09.945697 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 316/639] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:09 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1309 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:10.437312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9583f6ad-a0f0-4959-9f51-39ceac2a3775 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:10.438036 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-9583f6ad-a0f0-4959-9f51-39ceac2a3775 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:10.444556 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9583f6ad-a0f0-4959-9f51-39ceac2a3775 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:10.445714 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9583f6ad-a0f0-4959-9f51-39ceac2a3775 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:10.446712 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9583f6ad-a0f0-4959-9f51-39ceac2a3775 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:10.447460 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9583f6ad-a0f0-4959-9f51-39ceac2a3775 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:10.579974 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-9583f6ad-a0f0-4959-9f51-39ceac2a3775 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:10.588502 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-9583f6ad-a0f0-4959-9f51-39ceac2a3775 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:10.590004 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-9583f6ad-a0f0-4959-9f51-39ceac2a3775 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:10.591173 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-9583f6ad-a0f0-4959-9f51-39ceac2a3775 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.158623 May 10 17:50:10.591997 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 324/640] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:10 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:10.962922 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1ffa1a48-fb81-46f0-af77-10ae2b17ccbb tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:10.963550 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1ffa1a48-fb81-46f0-af77-10ae2b17ccbb tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:10.970013 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1ffa1a48-fb81-46f0-af77-10ae2b17ccbb tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:10.970464 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1ffa1a48-fb81-46f0-af77-10ae2b17ccbb tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:10.971255 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1ffa1a48-fb81-46f0-af77-10ae2b17ccbb tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:10.971757 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1ffa1a48-fb81-46f0-af77-10ae2b17ccbb tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:11.006153 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1ffa1a48-fb81-46f0-af77-10ae2b17ccbb tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:11.006602 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1ffa1a48-fb81-46f0-af77-10ae2b17ccbb tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:11.007054 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-1ffa1a48-fb81-46f0-af77-10ae2b17ccbb tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lazy-loading 'fault' on Instance uuid 4adcaebe-b2a0-4861-a874-24cbcdc8cd05 {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:50:11.051291 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1ffa1a48-fb81-46f0-af77-10ae2b17ccbb tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37203169f06d42c59dc670dc416caf38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2c0807e3fc4161b894f123e8acc473', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:11.059589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1ffa1a48-fb81-46f0-af77-10ae2b17ccbb tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 200 len: 1309 microversion: 2.1 time: 0.100940 May 10 17:50:11.060186 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 317/641] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:10 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:11.610831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2ad9755b-f249-44bd-ba37-f1da67023354 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:11.611740 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-2ad9755b-f249-44bd-ba37-f1da67023354 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:11.620169 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2ad9755b-f249-44bd-ba37-f1da67023354 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:11.620741 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2ad9755b-f249-44bd-ba37-f1da67023354 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:11.621649 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2ad9755b-f249-44bd-ba37-f1da67023354 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:11.622090 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2ad9755b-f249-44bd-ba37-f1da67023354 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:11.758547 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-2ad9755b-f249-44bd-ba37-f1da67023354 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:11.767762 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-2ad9755b-f249-44bd-ba37-f1da67023354 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:11.769262 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-2ad9755b-f249-44bd-ba37-f1da67023354 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:11.770685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-2ad9755b-f249-44bd-ba37-f1da67023354 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.165013 May 10 17:50:11.771242 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 325/642] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:11 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:12.077270 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-018a67dc-51e4-4621-ab15-7b073018da33 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:12.077982 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-018a67dc-51e4-4621-ab15-7b073018da33 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] [instance: 4adcaebe-b2a0-4861-a874-24cbcdc8cd05] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:12.084634 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-018a67dc-51e4-4621-ab15-7b073018da33 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:12.085120 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-018a67dc-51e4-4621-ab15-7b073018da33 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:12.085914 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-018a67dc-51e4-4621-ab15-7b073018da33 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:12.086345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-018a67dc-51e4-4621-ab15-7b073018da33 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:12.100363 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-018a67dc-51e4-4621-ab15-7b073018da33 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] HTTP exception thrown: Instance 4adcaebe-b2a0-4861-a874-24cbcdc8cd05 could not be found. May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-018a67dc-51e4-4621-ab15-7b073018da33 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Request method failure captured: May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 HTTP/1.1 May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqTbQezBWYbLJ1lEvxdEF9zxM8hQmdKHGxL6OEUo6GcqFpwA06Y02t5ECEXTa8KAxKnKNW1toi6PDRCwceHG1_lcGKwsimFsSvRWjqHATidcvJrVeeKRbcBFXJvN4xete-pl1yPyVXlnZNa7zRZkQ2CJcVbkAGkQJrnq3VcBUK3PEz4 May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: 9a2c0807e3fc4161b894f123e8acc473 May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1645568956 May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:50:12.102038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:50:12.103694 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a2c0807e3fc4161b894f123e8acc473"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/9a2c0807e3fc4161b894f123e8acc473"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_9a2c0807e3fc4161b894f123e8acc473"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/9a2c0807e3fc4161b894f123e8acc473"}]}] May 10 17:50:12.103694 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-VolumesSnapshotTestJSON-1645568956 May 10 17:50:12.103694 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 9a2c0807e3fc4161b894f123e8acc473 May 10 17:50:12.103694 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1645568956 May 10 17:50:12.103694 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-VolumesSnapshotTestJSON-1645568956-project May 10 17:50:12.103694 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:50:12.103694 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:50:12.103694 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: 37203169f06d42c59dc670dc416caf38 May 10 17:50:12.103694 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-VolumesSnapshotTestJSON-1645568956-project May 10 17:50:12.103694 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:50:12.103694 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance 4adcaebe-b2a0-4861-a874-24cbcdc8cd05 could not be found. May 10 17:50:12.103694 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': '4adcaebe-b2a0-4861-a874-24cbcdc8cd05'} May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4adcaebe-b2a0-4861-a874-24cbcdc8cd05 could not be found. May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:50:12.104684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:50:12.106168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:50:12.106168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:50:12.106168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:50:12.106168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:50:12.106168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:50:12.106168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:50:12.106168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:50:12.106168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4adcaebe-b2a0-4861-a874-24cbcdc8cd05 could not be found. May 10 17:50:12.106168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:50:12.106168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:50:12.106168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:50:12.106168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:50:12.106168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:50:12.106168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:50:12.106168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:50:12.106168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:50:12.106168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4adcaebe-b2a0-4861-a874-24cbcdc8cd05 could not be found. May 10 17:50:12.106168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:50:12.108235 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-018a67dc-51e4-4621-ab15-7b073018da33 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] Returning 404 to user: Instance 4adcaebe-b2a0-4861-a874-24cbcdc8cd05 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:50:12.108235 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-018a67dc-51e4-4621-ab15-7b073018da33 tempest-VolumesSnapshotTestJSON-1645568956 tempest-VolumesSnapshotTestJSON-1645568956-project] 10.222.0.60 "GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05" status: 404 len: 111 microversion: 2.1 time: 0.030092 May 10 17:50:12.108235 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 318/643] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:12 2022] GET /compute/v2.1/servers/4adcaebe-b2a0-4861-a874-24cbcdc8cd05 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:50:12.793921 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1b843abb-a5b5-48c8-a617-b63bc3ec9399 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:12.794529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-1b843abb-a5b5-48c8-a617-b63bc3ec9399 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:12.801200 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1b843abb-a5b5-48c8-a617-b63bc3ec9399 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:12.801653 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1b843abb-a5b5-48c8-a617-b63bc3ec9399 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:12.802425 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1b843abb-a5b5-48c8-a617-b63bc3ec9399 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:12.802864 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1b843abb-a5b5-48c8-a617-b63bc3ec9399 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:12.937225 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1b843abb-a5b5-48c8-a617-b63bc3ec9399 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:12.945814 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1b843abb-a5b5-48c8-a617-b63bc3ec9399 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:12.947604 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1b843abb-a5b5-48c8-a617-b63bc3ec9399 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:12.948765 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-1b843abb-a5b5-48c8-a617-b63bc3ec9399 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.158879 May 10 17:50:12.949337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 326/644] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:12 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:13.966247 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3c81c874-f836-49f5-a382-601e4bdf3b07 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:13.966858 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3c81c874-f836-49f5-a382-601e4bdf3b07 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:13.973369 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3c81c874-f836-49f5-a382-601e4bdf3b07 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:13.973821 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3c81c874-f836-49f5-a382-601e4bdf3b07 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:13.974636 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3c81c874-f836-49f5-a382-601e4bdf3b07 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:13.975081 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3c81c874-f836-49f5-a382-601e4bdf3b07 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:14.110864 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3c81c874-f836-49f5-a382-601e4bdf3b07 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:14.120361 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3c81c874-f836-49f5-a382-601e4bdf3b07 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:14.121876 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3c81c874-f836-49f5-a382-601e4bdf3b07 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:14.123041 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3c81c874-f836-49f5-a382-601e4bdf3b07 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.160799 May 10 17:50:14.123633 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 319/645] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:13 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:15.141899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c2b2c391-f069-4908-b1ce-3e66de11c1e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:15.142471 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c2b2c391-f069-4908-b1ce-3e66de11c1e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:15.149309 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c2b2c391-f069-4908-b1ce-3e66de11c1e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:15.149762 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c2b2c391-f069-4908-b1ce-3e66de11c1e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:15.150548 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c2b2c391-f069-4908-b1ce-3e66de11c1e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:15.150989 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c2b2c391-f069-4908-b1ce-3e66de11c1e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:15.285049 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c2b2c391-f069-4908-b1ce-3e66de11c1e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:15.295037 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c2b2c391-f069-4908-b1ce-3e66de11c1e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:15.296580 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c2b2c391-f069-4908-b1ce-3e66de11c1e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:15.297813 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c2b2c391-f069-4908-b1ce-3e66de11c1e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.160110 May 10 17:50:15.298398 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 327/646] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:15 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:50:16.317588 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9d172699-2496-4406-99b2-fed2a63739a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:16.318222 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9d172699-2496-4406-99b2-fed2a63739a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:16.325363 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9d172699-2496-4406-99b2-fed2a63739a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:16.325823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9d172699-2496-4406-99b2-fed2a63739a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:16.326611 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9d172699-2496-4406-99b2-fed2a63739a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:16.327057 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9d172699-2496-4406-99b2-fed2a63739a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:16.469985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9d172699-2496-4406-99b2-fed2a63739a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:16.480209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9d172699-2496-4406-99b2-fed2a63739a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:16.482078 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9d172699-2496-4406-99b2-fed2a63739a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:16.483341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9d172699-2496-4406-99b2-fed2a63739a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.169940 May 10 17:50:16.484006 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 320/647] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:16 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:17.056364 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a862560d-bc05-480f-99ed-fdb36a682d61 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b79c0d6-1bab-4c94-8a2a-72d5d9e77fb4"}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:50:17.057533 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a862560d-bc05-480f-99ed-fdb36a682d61 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:17.063478 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a862560d-bc05-480f-99ed-fdb36a682d61 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:17.063927 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a862560d-bc05-480f-99ed-fdb36a682d61 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:17.064692 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a862560d-bc05-480f-99ed-fdb36a682d61 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:17.065126 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a862560d-bc05-480f-99ed-fdb36a682d61 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:17.503030 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c7298d4d-3490-4f28-9858-5e1fad62047c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:17.503763 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c7298d4d-3490-4f28-9858-5e1fad62047c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:17.510936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c7298d4d-3490-4f28-9858-5e1fad62047c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:17.511421 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c7298d4d-3490-4f28-9858-5e1fad62047c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:17.512219 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c7298d4d-3490-4f28-9858-5e1fad62047c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:17.512657 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c7298d4d-3490-4f28-9858-5e1fad62047c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:17.660284 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c7298d4d-3490-4f28-9858-5e1fad62047c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:17.676629 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c7298d4d-3490-4f28-9858-5e1fad62047c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:17.680993 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c7298d4d-3490-4f28-9858-5e1fad62047c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:17.683927 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c7298d4d-3490-4f28-9858-5e1fad62047c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.184074 May 10 17:50:17.691137 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 321/648] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:17 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:50:17.838826 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a862560d-bc05-480f-99ed-fdb36a682d61 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "POST /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.884851 May 10 17:50:17.839683 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 328/649] 10.222.0.60 () {60 vars in 1322 bytes} [Tue May 10 17:50:16 2022] POST /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/os-volume_attachments => generated 194 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:50:18.714824 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6f50c083-294b-4d19-8024-0ed9856b53c9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:18.715557 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6f50c083-294b-4d19-8024-0ed9856b53c9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:18.728241 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6f50c083-294b-4d19-8024-0ed9856b53c9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:18.728707 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6f50c083-294b-4d19-8024-0ed9856b53c9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:18.729532 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6f50c083-294b-4d19-8024-0ed9856b53c9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:18.730139 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6f50c083-294b-4d19-8024-0ed9856b53c9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:18.875428 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6f50c083-294b-4d19-8024-0ed9856b53c9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:18.886163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6f50c083-294b-4d19-8024-0ed9856b53c9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:18.887694 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6f50c083-294b-4d19-8024-0ed9856b53c9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:18.888937 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6f50c083-294b-4d19-8024-0ed9856b53c9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.179521 May 10 17:50:18.889614 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 322/650] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:18 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:19.908734 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a43bff2e-8b30-4291-8b53-3725b6df9b7b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:19.909433 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a43bff2e-8b30-4291-8b53-3725b6df9b7b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:19.915880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a43bff2e-8b30-4291-8b53-3725b6df9b7b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:19.916334 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a43bff2e-8b30-4291-8b53-3725b6df9b7b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:19.917112 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a43bff2e-8b30-4291-8b53-3725b6df9b7b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:19.917553 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a43bff2e-8b30-4291-8b53-3725b6df9b7b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:20.085071 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a43bff2e-8b30-4291-8b53-3725b6df9b7b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:20.095270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a43bff2e-8b30-4291-8b53-3725b6df9b7b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:20.103906 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a43bff2e-8b30-4291-8b53-3725b6df9b7b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:20.105141 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a43bff2e-8b30-4291-8b53-3725b6df9b7b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.201355 May 10 17:50:20.115402 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 329/651] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:19 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:50:20.174782 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-0d995ffb-0263-47d2-87d1-a590035e698d req-d5d85b8e-331a-4486-99b5-338f409f1178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4006eed6-2338-46b7-9133-e5c3fdead35c", "name": "network-vif-plugged", "status": "completed", "tag": "e697d9cb-ff2b-45a4-8326-f3219cdf4121"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:50:20.184366 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-0d995ffb-0263-47d2-87d1-a590035e698d req-d5d85b8e-331a-4486-99b5-338f409f1178 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:20.184934 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-0d995ffb-0263-47d2-87d1-a590035e698d req-d5d85b8e-331a-4486-99b5-338f409f1178 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:20.197261 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-0d995ffb-0263-47d2-87d1-a590035e698d req-d5d85b8e-331a-4486-99b5-338f409f1178 service nova] Creating event network-vif-plugged:e697d9cb-ff2b-45a4-8326-f3219cdf4121 for instance 4006eed6-2338-46b7-9133-e5c3fdead35c on hv-cinder-84130 May 10 17:50:20.202485 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-0d995ffb-0263-47d2-87d1-a590035e698d req-d5d85b8e-331a-4486-99b5-338f409f1178 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119712 May 10 17:50:20.203099 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 323/652] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:50:21.125581 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f137e73d-4a28-48c5-a57c-6277a83ab5f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:21.126238 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f137e73d-4a28-48c5-a57c-6277a83ab5f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:21.132636 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f137e73d-4a28-48c5-a57c-6277a83ab5f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:21.133047 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f137e73d-4a28-48c5-a57c-6277a83ab5f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:21.133911 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f137e73d-4a28-48c5-a57c-6277a83ab5f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:21.134290 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f137e73d-4a28-48c5-a57c-6277a83ab5f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:21.273482 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f137e73d-4a28-48c5-a57c-6277a83ab5f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:21.282813 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f137e73d-4a28-48c5-a57c-6277a83ab5f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:21.284409 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f137e73d-4a28-48c5-a57c-6277a83ab5f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:21.285586 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f137e73d-4a28-48c5-a57c-6277a83ab5f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.163928 May 10 17:50:21.286156 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 330/653] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:21 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:22.305592 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0ea78e97-1c35-4dad-a4fd-680468157f74 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:22.306273 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0ea78e97-1c35-4dad-a4fd-680468157f74 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:22.312679 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0ea78e97-1c35-4dad-a4fd-680468157f74 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:22.313127 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0ea78e97-1c35-4dad-a4fd-680468157f74 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:22.313906 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0ea78e97-1c35-4dad-a4fd-680468157f74 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:22.314340 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0ea78e97-1c35-4dad-a4fd-680468157f74 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:22.462489 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0ea78e97-1c35-4dad-a4fd-680468157f74 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:22.471246 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0ea78e97-1c35-4dad-a4fd-680468157f74 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:22.472772 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0ea78e97-1c35-4dad-a4fd-680468157f74 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:22.473951 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0ea78e97-1c35-4dad-a4fd-680468157f74 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.173174 May 10 17:50:22.474516 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 324/654] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:22 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:23.492405 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-33c4ffd4-9761-4714-ae21-4b63c631797f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:23.493773 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-33c4ffd4-9761-4714-ae21-4b63c631797f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:23.500512 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-33c4ffd4-9761-4714-ae21-4b63c631797f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:23.500969 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-33c4ffd4-9761-4714-ae21-4b63c631797f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:23.501757 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-33c4ffd4-9761-4714-ae21-4b63c631797f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:23.502217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-33c4ffd4-9761-4714-ae21-4b63c631797f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:23.672518 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-33c4ffd4-9761-4714-ae21-4b63c631797f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:23.687721 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-33c4ffd4-9761-4714-ae21-4b63c631797f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:23.690006 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-33c4ffd4-9761-4714-ae21-4b63c631797f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:23.691930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-33c4ffd4-9761-4714-ae21-4b63c631797f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.203236 May 10 17:50:23.692618 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 331/655] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:23 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:24.711693 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5dcf047c-4f31-4ef7-a5c0-1fb50a805df1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:24.712418 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5dcf047c-4f31-4ef7-a5c0-1fb50a805df1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:24.718900 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5dcf047c-4f31-4ef7-a5c0-1fb50a805df1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:24.719348 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5dcf047c-4f31-4ef7-a5c0-1fb50a805df1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:24.720144 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5dcf047c-4f31-4ef7-a5c0-1fb50a805df1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:24.720578 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5dcf047c-4f31-4ef7-a5c0-1fb50a805df1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:24.862747 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5dcf047c-4f31-4ef7-a5c0-1fb50a805df1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:24.871905 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5dcf047c-4f31-4ef7-a5c0-1fb50a805df1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:24.873461 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5dcf047c-4f31-4ef7-a5c0-1fb50a805df1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:24.874661 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5dcf047c-4f31-4ef7-a5c0-1fb50a805df1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.167473 May 10 17:50:24.875231 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 325/656] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:24 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:25.893016 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f44a3dc0-62ad-4898-9887-3cb5345960e9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:25.894311 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f44a3dc0-62ad-4898-9887-3cb5345960e9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:25.901205 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f44a3dc0-62ad-4898-9887-3cb5345960e9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:25.901657 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f44a3dc0-62ad-4898-9887-3cb5345960e9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:25.902429 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f44a3dc0-62ad-4898-9887-3cb5345960e9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:25.902888 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f44a3dc0-62ad-4898-9887-3cb5345960e9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:26.048293 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f44a3dc0-62ad-4898-9887-3cb5345960e9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:26.057886 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f44a3dc0-62ad-4898-9887-3cb5345960e9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:26.059408 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f44a3dc0-62ad-4898-9887-3cb5345960e9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:26.060594 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f44a3dc0-62ad-4898-9887-3cb5345960e9 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.171590 May 10 17:50:26.061166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 332/657] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:25 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:27.079057 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ad523792-5801-4d30-878c-8aa5b725aa53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:27.079666 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ad523792-5801-4d30-878c-8aa5b725aa53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:27.086438 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ad523792-5801-4d30-878c-8aa5b725aa53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:27.086894 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ad523792-5801-4d30-878c-8aa5b725aa53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:27.087704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ad523792-5801-4d30-878c-8aa5b725aa53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:27.088151 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ad523792-5801-4d30-878c-8aa5b725aa53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:27.225506 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ad523792-5801-4d30-878c-8aa5b725aa53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:27.234719 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ad523792-5801-4d30-878c-8aa5b725aa53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:27.236319 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ad523792-5801-4d30-878c-8aa5b725aa53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:27.237491 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ad523792-5801-4d30-878c-8aa5b725aa53 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.162362 May 10 17:50:27.238049 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 326/658] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:27 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:28.255589 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-6c619911-5cff-47ab-ac48-f1099aadd45e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:28.256200 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-6c619911-5cff-47ab-ac48-f1099aadd45e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:28.266264 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6c619911-5cff-47ab-ac48-f1099aadd45e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:28.266806 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6c619911-5cff-47ab-ac48-f1099aadd45e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:28.267652 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6c619911-5cff-47ab-ac48-f1099aadd45e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:28.268054 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6c619911-5cff-47ab-ac48-f1099aadd45e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:28.413227 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6c619911-5cff-47ab-ac48-f1099aadd45e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:28.422659 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6c619911-5cff-47ab-ac48-f1099aadd45e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:28.424237 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6c619911-5cff-47ab-ac48-f1099aadd45e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:28.425449 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-6c619911-5cff-47ab-ac48-f1099aadd45e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1809 microversion: 2.20 time: 0.173843 May 10 17:50:28.426013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 333/659] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:28 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:29.454983 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-da256866-b686-4dfb-bf21-b9430db7ecf3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:29.456124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-da256866-b686-4dfb-bf21-b9430db7ecf3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:29.467481 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-da256866-b686-4dfb-bf21-b9430db7ecf3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:29.468069 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-da256866-b686-4dfb-bf21-b9430db7ecf3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:29.469212 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-da256866-b686-4dfb-bf21-b9430db7ecf3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:29.469743 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-da256866-b686-4dfb-bf21-b9430db7ecf3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:29.645564 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-da256866-b686-4dfb-bf21-b9430db7ecf3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:29.657715 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-da256866-b686-4dfb-bf21-b9430db7ecf3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:29.659825 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-da256866-b686-4dfb-bf21-b9430db7ecf3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:29.661148 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-da256866-b686-4dfb-bf21-b9430db7ecf3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1796 microversion: 2.20 time: 0.213882 May 10 17:50:29.661795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 327/660] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:50:29 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1796 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:50:30.684786 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9582d278-72ef-4462-8826-12628e39f583 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:50:30.686182 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-9582d278-72ef-4462-8826-12628e39f583 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:30.691918 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9582d278-72ef-4462-8826-12628e39f583 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:30.692368 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9582d278-72ef-4462-8826-12628e39f583 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:30.693139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9582d278-72ef-4462-8826-12628e39f583 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:30.693579 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9582d278-72ef-4462-8826-12628e39f583 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:30.716412 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.objects.instance [None req-9582d278-72ef-4462-8826-12628e39f583 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lazy-loading 'flavor' on Instance uuid e4553a66-9c17-4820-a5ab-1e3f45b42cb2 {{(pid=123753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:50:30.848800 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-9582d278-72ef-4462-8826-12628e39f583 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "POST /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/action" status: 200 len: 32 microversion: 2.1 time: 0.168672 May 10 17:50:30.849325 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 334/661] 10.222.0.60 () {60 vars in 1277 bytes} [Tue May 10 17:50:30 2022] POST /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:50:30.859901 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-34c648b4-6d76-409e-95b2-d88e3bb4ddca tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:30.860767 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-34c648b4-6d76-409e-95b2-d88e3bb4ddca tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:30.868510 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34c648b4-6d76-409e-95b2-d88e3bb4ddca tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:30.868944 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34c648b4-6d76-409e-95b2-d88e3bb4ddca tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:30.869757 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34c648b4-6d76-409e-95b2-d88e3bb4ddca tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:30.870203 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34c648b4-6d76-409e-95b2-d88e3bb4ddca tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:31.110916 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-34c648b4-6d76-409e-95b2-d88e3bb4ddca tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:31.119193 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-34c648b4-6d76-409e-95b2-d88e3bb4ddca tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1735 microversion: 2.1 time: 0.263163 May 10 17:50:31.120122 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 328/662] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:30 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1735 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:32.139233 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5b4c9b19-1245-4e90-b82f-5093cbfffcef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:32.139865 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5b4c9b19-1245-4e90-b82f-5093cbfffcef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:32.146198 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5b4c9b19-1245-4e90-b82f-5093cbfffcef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:32.146658 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5b4c9b19-1245-4e90-b82f-5093cbfffcef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:32.147463 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5b4c9b19-1245-4e90-b82f-5093cbfffcef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:32.147910 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5b4c9b19-1245-4e90-b82f-5093cbfffcef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:32.285309 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-5b4c9b19-1245-4e90-b82f-5093cbfffcef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:32.294229 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-5b4c9b19-1245-4e90-b82f-5093cbfffcef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1735 microversion: 2.1 time: 0.159916 May 10 17:50:32.294883 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 335/663] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:32 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:33.312215 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b840bee9-c0f6-450c-b84f-11dfb2714eec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:33.312790 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b840bee9-c0f6-450c-b84f-11dfb2714eec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:33.319845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b840bee9-c0f6-450c-b84f-11dfb2714eec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:33.320331 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b840bee9-c0f6-450c-b84f-11dfb2714eec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:33.321141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b840bee9-c0f6-450c-b84f-11dfb2714eec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:33.321584 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b840bee9-c0f6-450c-b84f-11dfb2714eec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:33.462765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b840bee9-c0f6-450c-b84f-11dfb2714eec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:33.476989 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b840bee9-c0f6-450c-b84f-11dfb2714eec tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1735 microversion: 2.1 time: 0.168283 May 10 17:50:33.477888 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 329/664] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:33 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:34.494688 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f19800db-7986-4f5f-bff2-9e64dfe53548 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:34.495327 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f19800db-7986-4f5f-bff2-9e64dfe53548 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:34.501961 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f19800db-7986-4f5f-bff2-9e64dfe53548 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:34.502411 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f19800db-7986-4f5f-bff2-9e64dfe53548 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:34.503194 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f19800db-7986-4f5f-bff2-9e64dfe53548 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:34.503653 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f19800db-7986-4f5f-bff2-9e64dfe53548 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:34.714511 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f19800db-7986-4f5f-bff2-9e64dfe53548 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:34.727640 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f19800db-7986-4f5f-bff2-9e64dfe53548 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1735 microversion: 2.1 time: 0.236149 May 10 17:50:34.728301 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 336/665] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:34 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1735 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:35.745630 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-30045207-fc95-48c2-95a4-58cf06e0e3cc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:35.746240 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-30045207-fc95-48c2-95a4-58cf06e0e3cc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:35.752804 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-30045207-fc95-48c2-95a4-58cf06e0e3cc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:35.753263 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-30045207-fc95-48c2-95a4-58cf06e0e3cc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:35.754045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-30045207-fc95-48c2-95a4-58cf06e0e3cc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:35.754487 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-30045207-fc95-48c2-95a4-58cf06e0e3cc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:35.897616 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-30045207-fc95-48c2-95a4-58cf06e0e3cc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:35.907056 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-30045207-fc95-48c2-95a4-58cf06e0e3cc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1735 microversion: 2.1 time: 0.166012 May 10 17:50:35.907664 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 330/666] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:35 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:36.924579 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-d7be381e-dcde-408a-9e68-ea0bef286e0e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:36.925225 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-d7be381e-dcde-408a-9e68-ea0bef286e0e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:36.931785 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d7be381e-dcde-408a-9e68-ea0bef286e0e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:36.932238 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d7be381e-dcde-408a-9e68-ea0bef286e0e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:36.933016 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d7be381e-dcde-408a-9e68-ea0bef286e0e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:36.933456 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d7be381e-dcde-408a-9e68-ea0bef286e0e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:37.076280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-d7be381e-dcde-408a-9e68-ea0bef286e0e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:37.084382 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-d7be381e-dcde-408a-9e68-ea0bef286e0e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1735 microversion: 2.1 time: 0.163626 May 10 17:50:37.085163 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 337/667] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:36 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:38.103902 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1c29f3b6-091c-4ef9-b9a3-16b487b43b41 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:38.104461 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1c29f3b6-091c-4ef9-b9a3-16b487b43b41 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:38.111314 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1c29f3b6-091c-4ef9-b9a3-16b487b43b41 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:38.111813 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1c29f3b6-091c-4ef9-b9a3-16b487b43b41 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:38.112612 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1c29f3b6-091c-4ef9-b9a3-16b487b43b41 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:38.113057 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1c29f3b6-091c-4ef9-b9a3-16b487b43b41 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:38.268217 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1c29f3b6-091c-4ef9-b9a3-16b487b43b41 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:38.277471 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1c29f3b6-091c-4ef9-b9a3-16b487b43b41 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1735 microversion: 2.1 time: 0.178788 May 10 17:50:38.278161 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 331/668] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:38 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:39.295924 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5b91011d-667b-49d6-99ad-c96a9583e940 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:39.296539 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5b91011d-667b-49d6-99ad-c96a9583e940 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:39.303128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5b91011d-667b-49d6-99ad-c96a9583e940 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:39.303624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5b91011d-667b-49d6-99ad-c96a9583e940 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:39.305019 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5b91011d-667b-49d6-99ad-c96a9583e940 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:39.306078 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5b91011d-667b-49d6-99ad-c96a9583e940 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:39.452396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-5b91011d-667b-49d6-99ad-c96a9583e940 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:39.460224 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-5b91011d-667b-49d6-99ad-c96a9583e940 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1735 microversion: 2.1 time: 0.168163 May 10 17:50:39.461000 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 338/669] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:39 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:40.477721 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-39b2d744-c695-4b7f-9731-4e7c9ce39643 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:40.478348 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-39b2d744-c695-4b7f-9731-4e7c9ce39643 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:40.484850 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-39b2d744-c695-4b7f-9731-4e7c9ce39643 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:40.485305 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-39b2d744-c695-4b7f-9731-4e7c9ce39643 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:40.486096 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-39b2d744-c695-4b7f-9731-4e7c9ce39643 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:40.486537 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-39b2d744-c695-4b7f-9731-4e7c9ce39643 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:40.631761 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-39b2d744-c695-4b7f-9731-4e7c9ce39643 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:40.640395 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-39b2d744-c695-4b7f-9731-4e7c9ce39643 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1735 microversion: 2.1 time: 0.166587 May 10 17:50:40.640995 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 332/670] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:40 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:41.659615 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9b2ceda0-0204-438b-a3db-242d60132dfc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:41.660222 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-9b2ceda0-0204-438b-a3db-242d60132dfc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:41.667576 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9b2ceda0-0204-438b-a3db-242d60132dfc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:41.668030 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9b2ceda0-0204-438b-a3db-242d60132dfc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:41.668812 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9b2ceda0-0204-438b-a3db-242d60132dfc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:41.669248 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9b2ceda0-0204-438b-a3db-242d60132dfc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:41.811914 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-9b2ceda0-0204-438b-a3db-242d60132dfc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:41.821811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-9b2ceda0-0204-438b-a3db-242d60132dfc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1735 microversion: 2.1 time: 0.166115 May 10 17:50:41.822688 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 339/671] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:41 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:42.840756 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7e5fcccb-76cb-42ad-ab2a-24539ce414da tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:42.841480 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7e5fcccb-76cb-42ad-ab2a-24539ce414da tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:42.848552 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7e5fcccb-76cb-42ad-ab2a-24539ce414da tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:42.849113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7e5fcccb-76cb-42ad-ab2a-24539ce414da tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:42.849954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7e5fcccb-76cb-42ad-ab2a-24539ce414da tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:42.850364 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7e5fcccb-76cb-42ad-ab2a-24539ce414da tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:43.018540 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7e5fcccb-76cb-42ad-ab2a-24539ce414da tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:43.027011 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7e5fcccb-76cb-42ad-ab2a-24539ce414da tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1735 microversion: 2.1 time: 0.190597 May 10 17:50:43.027818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 333/672] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:42 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:44.045702 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8a7fca48-3380-437d-bc3e-7b67ee120116 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:44.046337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8a7fca48-3380-437d-bc3e-7b67ee120116 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:44.052936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8a7fca48-3380-437d-bc3e-7b67ee120116 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:44.053392 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8a7fca48-3380-437d-bc3e-7b67ee120116 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:44.054257 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8a7fca48-3380-437d-bc3e-7b67ee120116 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:44.055261 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8a7fca48-3380-437d-bc3e-7b67ee120116 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:44.193034 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-8a7fca48-3380-437d-bc3e-7b67ee120116 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:44.201711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8a7fca48-3380-437d-bc3e-7b67ee120116 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1735 microversion: 2.1 time: 0.160268 May 10 17:50:44.202289 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 340/673] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:44 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:45.219848 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-758f7310-8e84-419a-a3c5-f7feccd23e89 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:45.221777 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-758f7310-8e84-419a-a3c5-f7feccd23e89 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:45.229563 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-758f7310-8e84-419a-a3c5-f7feccd23e89 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:45.230298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-758f7310-8e84-419a-a3c5-f7feccd23e89 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:45.231106 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-758f7310-8e84-419a-a3c5-f7feccd23e89 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:45.231751 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-758f7310-8e84-419a-a3c5-f7feccd23e89 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:45.844904 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-758f7310-8e84-419a-a3c5-f7feccd23e89 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:45.857504 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-758f7310-8e84-419a-a3c5-f7feccd23e89 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1735 microversion: 2.1 time: 0.641537 May 10 17:50:45.867378 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 334/674] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:45 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1735 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:46.874311 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b3803aaf-6d4a-4ca4-bd95-30d8f29dfa29 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:46.874933 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-b3803aaf-6d4a-4ca4-bd95-30d8f29dfa29 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:46.881919 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b3803aaf-6d4a-4ca4-bd95-30d8f29dfa29 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:46.882410 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b3803aaf-6d4a-4ca4-bd95-30d8f29dfa29 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:46.883204 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b3803aaf-6d4a-4ca4-bd95-30d8f29dfa29 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:46.883679 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b3803aaf-6d4a-4ca4-bd95-30d8f29dfa29 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:47.044531 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b3803aaf-6d4a-4ca4-bd95-30d8f29dfa29 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:47.054161 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b3803aaf-6d4a-4ca4-bd95-30d8f29dfa29 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1735 microversion: 2.1 time: 0.183833 May 10 17:50:47.055823 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 341/675] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:46 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:48.075229 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-81a75e87-cce5-47af-9021-bb52345bb25a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:48.075863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-81a75e87-cce5-47af-9021-bb52345bb25a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:48.083659 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-81a75e87-cce5-47af-9021-bb52345bb25a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:48.084126 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-81a75e87-cce5-47af-9021-bb52345bb25a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:48.085230 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-81a75e87-cce5-47af-9021-bb52345bb25a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:48.086338 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-81a75e87-cce5-47af-9021-bb52345bb25a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:48.367733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-81a75e87-cce5-47af-9021-bb52345bb25a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:48.378067 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-81a75e87-cce5-47af-9021-bb52345bb25a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1735 microversion: 2.1 time: 0.308552 May 10 17:50:48.378828 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 335/676] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:48 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1735 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:49.401821 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fab29aae-3bfb-46e2-8b95-2d9724e9d18e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:49.402593 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-fab29aae-3bfb-46e2-8b95-2d9724e9d18e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:49.409688 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fab29aae-3bfb-46e2-8b95-2d9724e9d18e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:49.410148 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fab29aae-3bfb-46e2-8b95-2d9724e9d18e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:49.410932 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fab29aae-3bfb-46e2-8b95-2d9724e9d18e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:49.411600 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fab29aae-3bfb-46e2-8b95-2d9724e9d18e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:49.973125 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fab29aae-3bfb-46e2-8b95-2d9724e9d18e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:49.982287 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-fab29aae-3bfb-46e2-8b95-2d9724e9d18e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1735 microversion: 2.1 time: 0.584854 May 10 17:50:49.982903 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 342/677] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:49 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1735 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:50.998529 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8482fa09-0dfe-44ba-9bc6-69a010d7f67b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:50.999447 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8482fa09-0dfe-44ba-9bc6-69a010d7f67b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:51.012180 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8482fa09-0dfe-44ba-9bc6-69a010d7f67b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:51.012766 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8482fa09-0dfe-44ba-9bc6-69a010d7f67b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:51.013841 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8482fa09-0dfe-44ba-9bc6-69a010d7f67b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:51.016333 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8482fa09-0dfe-44ba-9bc6-69a010d7f67b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:51.361789 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8482fa09-0dfe-44ba-9bc6-69a010d7f67b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:51.374989 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8482fa09-0dfe-44ba-9bc6-69a010d7f67b tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1735 microversion: 2.1 time: 0.380082 May 10 17:50:51.388817 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 336/678] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:50 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1735 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:52.393293 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ca56e8e2-2af4-422a-ac5d-e0d96a0080b1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:52.393936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ca56e8e2-2af4-422a-ac5d-e0d96a0080b1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:52.401220 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ca56e8e2-2af4-422a-ac5d-e0d96a0080b1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:52.401936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ca56e8e2-2af4-422a-ac5d-e0d96a0080b1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:52.402747 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ca56e8e2-2af4-422a-ac5d-e0d96a0080b1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:52.403381 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ca56e8e2-2af4-422a-ac5d-e0d96a0080b1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:52.555130 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ca56e8e2-2af4-422a-ac5d-e0d96a0080b1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:52.564577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ca56e8e2-2af4-422a-ac5d-e0d96a0080b1 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1715 microversion: 2.1 time: 0.175018 May 10 17:50:52.581696 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 343/679] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:52 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1715 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:52.716710 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4982eb06-1e68-4b7d-983d-c91204dca637 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:52.717242 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4982eb06-1e68-4b7d-983d-c91204dca637 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:52.725058 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4982eb06-1e68-4b7d-983d-c91204dca637 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:52.725523 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4982eb06-1e68-4b7d-983d-c91204dca637 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:52.727167 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4982eb06-1e68-4b7d-983d-c91204dca637 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:52.728562 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4982eb06-1e68-4b7d-983d-c91204dca637 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:52.859607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-4982eb06-1e68-4b7d-983d-c91204dca637 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] HTTP exception thrown: Cannot 'detach_volume' instance e4553a66-9c17-4820-a5ab-1e3f45b42cb2 while it is in vm_state rescued May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4982eb06-1e68-4b7d-983d-c91204dca637 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Request method failure captured: May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: DELETE /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/os-volume_attachments/0b79c0d6-1bab-4c94-8a2a-72d5d9e77fb4 HTTP/1.1 May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqSOYGFPOd_dSxQaw1xfXQL_oNPyInp9GeEXMVahMzSoBYuT3KiscvPKi3HBhjiWcLRLnDswKdZfNWCZzA6zRi1fmpAEigHOnkwk7Hg_h3oQ0KqrQ-oT8nZjHwnyBn82tUZ647WdoHFkg0oukih8HeJ54y7rT7g4d_iUCDyYKQuR3Xs May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: ec9da2f35bcd444fa485c453103df5cc May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1659970125 May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:50:52.861815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:50:52.863190 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec9da2f35bcd444fa485c453103df5cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ec9da2f35bcd444fa485c453103df5cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ec9da2f35bcd444fa485c453103df5cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec9da2f35bcd444fa485c453103df5cc"}]}] May 10 17:50:52.863190 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1659970125 May 10 17:50:52.863190 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: ec9da2f35bcd444fa485c453103df5cc May 10 17:50:52.863190 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1659970125 May 10 17:50:52.863190 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-ServerRescueNegativeTestJSON-1659970125-project May 10 17:50:52.863190 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:50:52.863190 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:50:52.863190 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: 93f2755bf7ac430f9380bf2cf3ecb97f May 10 17:50:52.863190 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1659970125-project May 10 17:50:52.863190 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:50:52.863190 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Cannot 'detach_volume' instance e4553a66-9c17-4820-a5ab-1e3f45b42cb2 while it is in vm_state rescued May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'server_id': 'e4553a66-9c17-4820-a5ab-1e3f45b42cb2', 'id': '0b79c0d6-1bab-4c94-8a2a-72d5d9e77fb4'} May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e4553a66-9c17-4820-a5ab-1e3f45b42cb2 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:50:52.864039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:50:52.865933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 10 17:50:52.865933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 10 17:50:52.865933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 10 17:50:52.865933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 10 17:50:52.865933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance e4553a66-9c17-4820-a5ab-1e3f45b42cb2 while it is in vm_state rescued May 10 17:50:52.865933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:50:52.865933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:50:52.865933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:50:52.865933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:50:52.865933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:50:52.865933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:50:52.865933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:50:52.865933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:50:52.865933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance e4553a66-9c17-4820-a5ab-1e3f45b42cb2 while it is in vm_state rescued May 10 17:50:52.865933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:50:52.865933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4982eb06-1e68-4b7d-983d-c91204dca637 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Returning 409 to user: Cannot 'detach_volume' instance e4553a66-9c17-4820-a5ab-1e3f45b42cb2 while it is in vm_state rescued {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:50:52.868412 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4982eb06-1e68-4b7d-983d-c91204dca637 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/os-volume_attachments/0b79c0d6-1bab-4c94-8a2a-72d5d9e77fb4" status: 409 len: 152 microversion: 2.1 time: 0.150824 May 10 17:50:52.868412 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 337/680] 10.222.0.60 () {58 vars in 1415 bytes} [Tue May 10 17:50:52 2022] DELETE /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/os-volume_attachments/0b79c0d6-1bab-4c94-8a2a-72d5d9e77fb4 => generated 152 bytes in 152 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 10 17:50:52.873511 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-66bdf217-fe03-49ad-a813-d18c227bb27e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:50:52.883411 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-66bdf217-fe03-49ad-a813-d18c227bb27e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:52.891096 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-66bdf217-fe03-49ad-a813-d18c227bb27e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:52.891675 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-66bdf217-fe03-49ad-a813-d18c227bb27e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:52.892343 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-66bdf217-fe03-49ad-a813-d18c227bb27e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:52.892786 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-66bdf217-fe03-49ad-a813-d18c227bb27e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:52.984078 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-66bdf217-fe03-49ad-a813-d18c227bb27e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "POST /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/action" status: 202 len: 0 microversion: 2.1 time: 0.113831 May 10 17:50:52.984611 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 344/681] 10.222.0.60 () {60 vars in 1277 bytes} [Tue May 10 17:50:52 2022] POST /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:50:53.004805 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-dcbcce08-6fbd-4781-837d-3ec9baa1fbe0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:53.005886 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-dcbcce08-6fbd-4781-837d-3ec9baa1fbe0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:53.014332 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-dcbcce08-6fbd-4781-837d-3ec9baa1fbe0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:53.015066 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-dcbcce08-6fbd-4781-837d-3ec9baa1fbe0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:53.016136 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-dcbcce08-6fbd-4781-837d-3ec9baa1fbe0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:53.016760 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-dcbcce08-6fbd-4781-837d-3ec9baa1fbe0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:53.218332 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-aa1bc8bc-7137-4739-ab61-25843d588b88 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Action: 'create', calling method: .version_select at 0x7f3e7bac91f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-630683051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlzc2UnqOQC85JZpbtfMT082gpxCrtP+it65J37DALlArZ07hZE/f91/1xzpua2Ep5gYDL3cN+qor9hKQR607hUrqyPeJ2k7btJpdWdrS1LFrSAMLeCNR66OvbUo9AQTQ=="}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:50:53.237101 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-aa1bc8bc-7137-4739-ab61-25843d588b88 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Getting quotas for project c93f0e69798e491aba3c8cf1493c2733. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:50:53.241944 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-aa1bc8bc-7137-4739-ab61-25843d588b88 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Getting quotas for user 798edb753845410fa6f9c136b43abf05 and project c93f0e69798e491aba3c8cf1493c2733. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:50:53.275302 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-aa1bc8bc-7137-4739-ab61-25843d588b88 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.301415 May 10 17:50:53.276073 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 338/682] 10.222.0.60 () {60 vars in 1158 bytes} [Tue May 10 17:50:52 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:50:53.326781 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-dcbcce08-6fbd-4781-837d-3ec9baa1fbe0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:53.343071 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-dcbcce08-6fbd-4781-837d-3ec9baa1fbe0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1723 microversion: 2.1 time: 0.347494 May 10 17:50:53.343999 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 345/683] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:52 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1723 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:54.367387 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7f3d05f6-3500-43df-8f29-cb234cdff728 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:54.368177 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7f3d05f6-3500-43df-8f29-cb234cdff728 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:54.376035 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7f3d05f6-3500-43df-8f29-cb234cdff728 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:54.376772 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7f3d05f6-3500-43df-8f29-cb234cdff728 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:54.377598 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7f3d05f6-3500-43df-8f29-cb234cdff728 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:54.378054 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7f3d05f6-3500-43df-8f29-cb234cdff728 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:54.538165 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7f3d05f6-3500-43df-8f29-cb234cdff728 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:54.549952 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7f3d05f6-3500-43df-8f29-cb234cdff728 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1723 microversion: 2.1 time: 0.192398 May 10 17:50:54.554397 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 339/684] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:54 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:50:55.569045 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2cab4713-3234-40ab-aa0c-07b9bd4a5e8e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:55.569678 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-2cab4713-3234-40ab-aa0c-07b9bd4a5e8e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:55.577065 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2cab4713-3234-40ab-aa0c-07b9bd4a5e8e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:55.577822 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2cab4713-3234-40ab-aa0c-07b9bd4a5e8e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:55.578294 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2cab4713-3234-40ab-aa0c-07b9bd4a5e8e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:55.578542 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2cab4713-3234-40ab-aa0c-07b9bd4a5e8e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:55.740742 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-2cab4713-3234-40ab-aa0c-07b9bd4a5e8e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:55.750814 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-2cab4713-3234-40ab-aa0c-07b9bd4a5e8e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1723 microversion: 2.1 time: 0.185891 May 10 17:50:55.751568 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 346/685] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:55 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:56.769505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-27f5de7a-9138-4525-8f69-3fd3e6cadd1a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:56.770226 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-27f5de7a-9138-4525-8f69-3fd3e6cadd1a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:56.777523 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-27f5de7a-9138-4525-8f69-3fd3e6cadd1a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:56.778208 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-27f5de7a-9138-4525-8f69-3fd3e6cadd1a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:56.779209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-27f5de7a-9138-4525-8f69-3fd3e6cadd1a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:56.779729 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-27f5de7a-9138-4525-8f69-3fd3e6cadd1a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:56.933797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-27f5de7a-9138-4525-8f69-3fd3e6cadd1a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:56.943487 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-27f5de7a-9138-4525-8f69-3fd3e6cadd1a tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1723 microversion: 2.1 time: 0.177776 May 10 17:50:56.959161 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 340/686] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:56 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:50:57.966197 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7d3677c3-434e-4372-80e8-b30812aa1e17 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:57.966809 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7d3677c3-434e-4372-80e8-b30812aa1e17 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:57.973196 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7d3677c3-434e-4372-80e8-b30812aa1e17 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:57.973647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7d3677c3-434e-4372-80e8-b30812aa1e17 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:57.974415 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7d3677c3-434e-4372-80e8-b30812aa1e17 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:57.974855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7d3677c3-434e-4372-80e8-b30812aa1e17 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:58.113116 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7d3677c3-434e-4372-80e8-b30812aa1e17 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:50:58.121256 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7d3677c3-434e-4372-80e8-b30812aa1e17 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1729 microversion: 2.1 time: 0.158981 May 10 17:50:58.121855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 347/687] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:50:57 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:50:58.139819 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-70748071-7864-4079-a9cd-286394c6d3b4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:50:58.140369 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-70748071-7864-4079-a9cd-286394c6d3b4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:50:58.146681 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-70748071-7864-4079-a9cd-286394c6d3b4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:58.147131 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-70748071-7864-4079-a9cd-286394c6d3b4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:58.148965 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-70748071-7864-4079-a9cd-286394c6d3b4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:58.149400 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-70748071-7864-4079-a9cd-286394c6d3b4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:58.228867 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-70748071-7864-4079-a9cd-286394c6d3b4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094243 May 10 17:50:58.229526 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 341/688] 10.222.0.60 () {58 vars in 1274 bytes} [Tue May 10 17:50:58 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:50:59.195573 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-f535f899-429a-4f08-9d41-503a2fbc4482 req-e7f86ac1-4150-482a-bda9-f1b5a018e3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4553a66-9c17-4820-a5ab-1e3f45b42cb2", "tag": "d41cfb7a-6772-4a26-bd70-17d9a9faa38c"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:50:59.206394 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-f535f899-429a-4f08-9d41-503a2fbc4482 req-e7f86ac1-4150-482a-bda9-f1b5a018e3b9 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:50:59.207234 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-f535f899-429a-4f08-9d41-503a2fbc4482 req-e7f86ac1-4150-482a-bda9-f1b5a018e3b9 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:50:59.219537 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-f535f899-429a-4f08-9d41-503a2fbc4482 req-e7f86ac1-4150-482a-bda9-f1b5a018e3b9 service nova] Creating event network-changed:d41cfb7a-6772-4a26-bd70-17d9a9faa38c for instance e4553a66-9c17-4820-a5ab-1e3f45b42cb2 on hv-cinder-84130 May 10 17:50:59.225293 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-f535f899-429a-4f08-9d41-503a2fbc4482 req-e7f86ac1-4150-482a-bda9-f1b5a018e3b9 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033918 May 10 17:50:59.227175 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 348/689] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:51:01.241032 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-7130d7e0-f288-467b-ad54-349c2b9a26cb req-89d090aa-73ef-475b-bb37-60585469af19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4553a66-9c17-4820-a5ab-1e3f45b42cb2", "tag": "d41cfb7a-6772-4a26-bd70-17d9a9faa38c"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:51:01.250724 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-7130d7e0-f288-467b-ad54-349c2b9a26cb req-89d090aa-73ef-475b-bb37-60585469af19 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:01.251269 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-7130d7e0-f288-467b-ad54-349c2b9a26cb req-89d090aa-73ef-475b-bb37-60585469af19 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:01.263542 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-7130d7e0-f288-467b-ad54-349c2b9a26cb req-89d090aa-73ef-475b-bb37-60585469af19 service nova] Creating event network-changed:d41cfb7a-6772-4a26-bd70-17d9a9faa38c for instance e4553a66-9c17-4820-a5ab-1e3f45b42cb2 on hv-cinder-84130 May 10 17:51:01.268794 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-7130d7e0-f288-467b-ad54-349c2b9a26cb req-89d090aa-73ef-475b-bb37-60585469af19 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031966 May 10 17:51:01.269359 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 342/690] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:51:03.666312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:51:03.666897 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Tue May 10 17:51:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:51:09.649370 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-bbf025e4-8f60-44c0-a13a-f23b8a5c6aa0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:51:09.650651 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-bbf025e4-8f60-44c0-a13a-f23b8a5c6aa0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:09.659527 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bbf025e4-8f60-44c0-a13a-f23b8a5c6aa0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:09.659981 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bbf025e4-8f60-44c0-a13a-f23b8a5c6aa0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:09.660752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bbf025e4-8f60-44c0-a13a-f23b8a5c6aa0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:09.661220 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bbf025e4-8f60-44c0-a13a-f23b8a5c6aa0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:09.732348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-bbf025e4-8f60-44c0-a13a-f23b8a5c6aa0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "POST /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb/action" status: 202 len: 0 microversion: 2.1 time: 0.087027 May 10 17:51:09.733029 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 349/691] 10.222.0.60 () {60 vars in 1277 bytes} [Tue May 10 17:51:09 2022] POST /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:51:09.742168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2f477fea-c822-4e6f-b170-40c3677845a8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:09.742977 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2f477fea-c822-4e6f-b170-40c3677845a8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:09.750334 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2f477fea-c822-4e6f-b170-40c3677845a8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:09.750905 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2f477fea-c822-4e6f-b170-40c3677845a8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:09.751726 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2f477fea-c822-4e6f-b170-40c3677845a8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:09.752168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2f477fea-c822-4e6f-b170-40c3677845a8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:09.993062 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2f477fea-c822-4e6f-b170-40c3677845a8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:10.000956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2f477fea-c822-4e6f-b170-40c3677845a8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1751 microversion: 2.1 time: 0.263512 May 10 17:51:10.001528 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 343/692] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:09 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1751 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:11.018920 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4c8f3f27-c4e9-4c37-9ed9-601892c3946c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:11.019673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4c8f3f27-c4e9-4c37-9ed9-601892c3946c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:11.025979 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4c8f3f27-c4e9-4c37-9ed9-601892c3946c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:11.026424 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4c8f3f27-c4e9-4c37-9ed9-601892c3946c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:11.027184 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4c8f3f27-c4e9-4c37-9ed9-601892c3946c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:11.027650 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4c8f3f27-c4e9-4c37-9ed9-601892c3946c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:11.174704 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4c8f3f27-c4e9-4c37-9ed9-601892c3946c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:11.183211 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4c8f3f27-c4e9-4c37-9ed9-601892c3946c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1756 microversion: 2.1 time: 0.168945 May 10 17:51:11.183799 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 350/693] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:11 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:12.201234 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e3e290ad-c495-4b2e-9799-c7d831b671d8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:12.201845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e3e290ad-c495-4b2e-9799-c7d831b671d8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:12.208337 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3e290ad-c495-4b2e-9799-c7d831b671d8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:12.208797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3e290ad-c495-4b2e-9799-c7d831b671d8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:12.209567 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3e290ad-c495-4b2e-9799-c7d831b671d8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:12.210012 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e3e290ad-c495-4b2e-9799-c7d831b671d8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:12.589306 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e3e290ad-c495-4b2e-9799-c7d831b671d8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:12.597140 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e3e290ad-c495-4b2e-9799-c7d831b671d8 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1756 microversion: 2.1 time: 0.400739 May 10 17:51:12.597705 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 344/694] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:12 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1756 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:13.614608 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-bbf0defe-b83c-4255-aafd-212560e4e916 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:13.615251 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-bbf0defe-b83c-4255-aafd-212560e4e916 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:13.621709 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bbf0defe-b83c-4255-aafd-212560e4e916 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:13.622165 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bbf0defe-b83c-4255-aafd-212560e4e916 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:13.622932 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bbf0defe-b83c-4255-aafd-212560e4e916 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:13.623387 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bbf0defe-b83c-4255-aafd-212560e4e916 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:13.771510 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-bbf0defe-b83c-4255-aafd-212560e4e916 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:13.779930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-bbf0defe-b83c-4255-aafd-212560e4e916 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1756 microversion: 2.1 time: 0.169145 May 10 17:51:13.780503 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 351/695] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:13 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:14.798283 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b5b2860f-9960-4e82-8630-199b909da3c1 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:14.798929 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b5b2860f-9960-4e82-8630-199b909da3c1 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:14.805303 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b5b2860f-9960-4e82-8630-199b909da3c1 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:14.805815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b5b2860f-9960-4e82-8630-199b909da3c1 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:14.806524 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b5b2860f-9960-4e82-8630-199b909da3c1 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:14.806965 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b5b2860f-9960-4e82-8630-199b909da3c1 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:14.949032 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b5b2860f-9960-4e82-8630-199b909da3c1 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:14.956840 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b5b2860f-9960-4e82-8630-199b909da3c1 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1756 microversion: 2.1 time: 0.163064 May 10 17:51:14.957398 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 345/696] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:14 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:15.974488 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-70da84f0-7362-4913-930f-cf26faf78a72 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:15.975090 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-70da84f0-7362-4913-930f-cf26faf78a72 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:15.983093 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-70da84f0-7362-4913-930f-cf26faf78a72 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:15.983575 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-70da84f0-7362-4913-930f-cf26faf78a72 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:15.984343 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-70da84f0-7362-4913-930f-cf26faf78a72 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:15.984776 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-70da84f0-7362-4913-930f-cf26faf78a72 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:16.143165 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-70da84f0-7362-4913-930f-cf26faf78a72 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:16.153305 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-70da84f0-7362-4913-930f-cf26faf78a72 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1756 microversion: 2.1 time: 0.182566 May 10 17:51:16.153876 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 352/697] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:15 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:17.172448 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ecb308d9-45f9-468d-8c15-0abaa134202b tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:17.173062 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ecb308d9-45f9-468d-8c15-0abaa134202b tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:17.179773 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ecb308d9-45f9-468d-8c15-0abaa134202b tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:17.181222 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ecb308d9-45f9-468d-8c15-0abaa134202b tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:17.182694 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ecb308d9-45f9-468d-8c15-0abaa134202b tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:17.182694 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ecb308d9-45f9-468d-8c15-0abaa134202b tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:17.342990 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ecb308d9-45f9-468d-8c15-0abaa134202b tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:17.351952 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ecb308d9-45f9-468d-8c15-0abaa134202b tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1756 microversion: 2.1 time: 0.183655 May 10 17:51:17.352525 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 346/698] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:17 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:18.369643 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-961f3cf9-cfac-47fd-88f2-525c3f8a0b09 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:18.370249 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-961f3cf9-cfac-47fd-88f2-525c3f8a0b09 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:18.377100 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-961f3cf9-cfac-47fd-88f2-525c3f8a0b09 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:18.377556 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-961f3cf9-cfac-47fd-88f2-525c3f8a0b09 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:18.378339 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-961f3cf9-cfac-47fd-88f2-525c3f8a0b09 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:18.378780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-961f3cf9-cfac-47fd-88f2-525c3f8a0b09 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:18.535076 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-961f3cf9-cfac-47fd-88f2-525c3f8a0b09 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:18.544124 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-961f3cf9-cfac-47fd-88f2-525c3f8a0b09 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1756 microversion: 2.1 time: 0.178293 May 10 17:51:18.544704 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 353/699] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:18 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:51:19.207878 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-dd7f83fd-a2db-4cc0-8d6b-15c92119e37c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1995464082", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-630683051", "security_groups": [{"name": "tempest-secgroup-smoke-900555845"}], "block_device_mapping_v2": [{"uuid": "667edbaa-b7b7-45d3-890b-0efa80bff20b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0e710c0b-0b9b-4762-af88-7b56961d06bc"}]}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:51:19.343332 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-dd7f83fd-a2db-4cc0-8d6b-15c92119e37c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] validate_networks() for [('0e710c0b-0b9b-4762-af88-7b56961d06bc', None, None, None, None, None)] {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:51:19.562074 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b6654672-878b-4f50-b38c-416180f98bc7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:19.563342 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-b6654672-878b-4f50-b38c-416180f98bc7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:19.569962 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b6654672-878b-4f50-b38c-416180f98bc7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:19.570415 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b6654672-878b-4f50-b38c-416180f98bc7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:19.571198 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b6654672-878b-4f50-b38c-416180f98bc7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:19.571661 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b6654672-878b-4f50-b38c-416180f98bc7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:19.817521 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b6654672-878b-4f50-b38c-416180f98bc7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:19.826410 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b6654672-878b-4f50-b38c-416180f98bc7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1756 microversion: 2.1 time: 0.268183 May 10 17:51:19.826991 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 354/700] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:19 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1756 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:51:19.857809 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-dd7f83fd-a2db-4cc0-8d6b-15c92119e37c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:51:19.858240 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-dd7f83fd-a2db-4cc0-8d6b-15c92119e37c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:51:19.858721 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-dd7f83fd-a2db-4cc0-8d6b-15c92119e37c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:51:19.859139 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-dd7f83fd-a2db-4cc0-8d6b-15c92119e37c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:51:19.859603 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-dd7f83fd-a2db-4cc0-8d6b-15c92119e37c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:51:19.874337 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dd7f83fd-a2db-4cc0-8d6b-15c92119e37c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:19.874795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dd7f83fd-a2db-4cc0-8d6b-15c92119e37c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:19.875660 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dd7f83fd-a2db-4cc0-8d6b-15c92119e37c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:19.876109 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dd7f83fd-a2db-4cc0-8d6b-15c92119e37c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:19.895171 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-dd7f83fd-a2db-4cc0-8d6b-15c92119e37c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Getting quotas for project c93f0e69798e491aba3c8cf1493c2733. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:51:19.900952 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-dd7f83fd-a2db-4cc0-8d6b-15c92119e37c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Getting quotas for user 798edb753845410fa6f9c136b43abf05 and project c93f0e69798e491aba3c8cf1493c2733. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:51:19.993640 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-dd7f83fd-a2db-4cc0-8d6b-15c92119e37c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:51:19.997405 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-dd7f83fd-a2db-4cc0-8d6b-15c92119e37c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='667edbaa-b7b7-45d3-890b-0efa80bff20b',volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:51:20.138212 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-dd7f83fd-a2db-4cc0-8d6b-15c92119e37c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.934476 May 10 17:51:20.139122 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 347/701] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 17:51:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 17:51:20.149590 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5246a35a-cbe5-44ed-9955-5404627cc4d7 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:20.150375 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5246a35a-cbe5-44ed-9955-5404627cc4d7 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:20.210517 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-5246a35a-cbe5-44ed-9955-5404627cc4d7 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:20.221307 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-5246a35a-cbe5-44ed-9955-5404627cc4d7 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1094 microversion: 2.1 time: 0.075554 May 10 17:51:20.222373 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 355/702] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:20 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:20.844883 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9b1ab2ef-070a-4035-a0b8-8d61db42614c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:20.845720 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9b1ab2ef-070a-4035-a0b8-8d61db42614c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:20.852410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b1ab2ef-070a-4035-a0b8-8d61db42614c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:20.853272 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b1ab2ef-070a-4035-a0b8-8d61db42614c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:20.853922 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b1ab2ef-070a-4035-a0b8-8d61db42614c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:20.854363 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9b1ab2ef-070a-4035-a0b8-8d61db42614c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:21.014728 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9b1ab2ef-070a-4035-a0b8-8d61db42614c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:21.023511 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9b1ab2ef-070a-4035-a0b8-8d61db42614c tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1756 microversion: 2.1 time: 0.182957 May 10 17:51:21.024084 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 348/703] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:20 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:51:21.247700 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e02b0202-bb84-473c-88c6-d1a26b79f1d6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:21.248443 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e02b0202-bb84-473c-88c6-d1a26b79f1d6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:21.261886 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e02b0202-bb84-473c-88c6-d1a26b79f1d6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:21.263177 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e02b0202-bb84-473c-88c6-d1a26b79f1d6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:21.264890 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e02b0202-bb84-473c-88c6-d1a26b79f1d6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:21.265342 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e02b0202-bb84-473c-88c6-d1a26b79f1d6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:21.345374 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e02b0202-bb84-473c-88c6-d1a26b79f1d6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:21.354067 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e02b0202-bb84-473c-88c6-d1a26b79f1d6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1192 microversion: 2.1 time: 0.111753 May 10 17:51:21.354659 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 356/704] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:21 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1192 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:22.041149 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-49088e1e-7aa4-4313-a702-00c3d215ff45 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:22.041754 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-49088e1e-7aa4-4313-a702-00c3d215ff45 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:22.049591 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-49088e1e-7aa4-4313-a702-00c3d215ff45 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:22.050226 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-49088e1e-7aa4-4313-a702-00c3d215ff45 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:22.051320 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-49088e1e-7aa4-4313-a702-00c3d215ff45 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:22.051981 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-49088e1e-7aa4-4313-a702-00c3d215ff45 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:22.376758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-cbf7db25-729e-40b4-9bdd-b93e1b6d3e06 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:22.377474 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-cbf7db25-729e-40b4-9bdd-b93e1b6d3e06 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:22.385314 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cbf7db25-729e-40b4-9bdd-b93e1b6d3e06 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:22.385727 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cbf7db25-729e-40b4-9bdd-b93e1b6d3e06 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:22.386993 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cbf7db25-729e-40b4-9bdd-b93e1b6d3e06 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:22.388293 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cbf7db25-729e-40b4-9bdd-b93e1b6d3e06 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:22.397948 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-49088e1e-7aa4-4313-a702-00c3d215ff45 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:22.412306 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-49088e1e-7aa4-4313-a702-00c3d215ff45 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1756 microversion: 2.1 time: 0.374779 May 10 17:51:22.424014 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 349/705] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:22 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1756 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:22.639818 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-cbf7db25-729e-40b4-9bdd-b93e1b6d3e06 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:22.648373 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-cbf7db25-729e-40b4-9bdd-b93e1b6d3e06 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1277 microversion: 2.1 time: 0.280088 May 10 17:51:22.648844 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 357/706] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:22 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1277 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:23.273139 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-1e562a0c-5c38-417d-80ab-c1c08dbc846c req-de08ca23-a063-418f-9212-9956db3e9ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55760f67-2403-45c9-8db7-d5ae5f45c366", "tag": "d083dfb1-18c3-4ce4-aee5-72cf745b342b"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:51:23.284661 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-1e562a0c-5c38-417d-80ab-c1c08dbc846c req-de08ca23-a063-418f-9212-9956db3e9ee0 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:23.285110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-1e562a0c-5c38-417d-80ab-c1c08dbc846c req-de08ca23-a063-418f-9212-9956db3e9ee0 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:23.309794 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-1e562a0c-5c38-417d-80ab-c1c08dbc846c req-de08ca23-a063-418f-9212-9956db3e9ee0 service nova] Creating event network-changed:d083dfb1-18c3-4ce4-aee5-72cf745b342b for instance 55760f67-2403-45c9-8db7-d5ae5f45c366 on hv-cinder-84130 May 10 17:51:23.316722 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-1e562a0c-5c38-417d-80ab-c1c08dbc846c req-de08ca23-a063-418f-9212-9956db3e9ee0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054291 May 10 17:51:23.317761 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 350/707] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:51:23.432433 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-462315b7-534b-40b5-beb8-c330dd88eb15 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:23.432986 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-462315b7-534b-40b5-beb8-c330dd88eb15 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:23.440654 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-462315b7-534b-40b5-beb8-c330dd88eb15 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:23.441183 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-462315b7-534b-40b5-beb8-c330dd88eb15 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:23.442050 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-462315b7-534b-40b5-beb8-c330dd88eb15 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:23.442684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-462315b7-534b-40b5-beb8-c330dd88eb15 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:23.650048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-462315b7-534b-40b5-beb8-c330dd88eb15 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:23.658712 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-462315b7-534b-40b5-beb8-c330dd88eb15 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1756 microversion: 2.1 time: 0.232030 May 10 17:51:23.659298 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 358/708] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:23 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1756 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:23.674358 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-789933b3-0ee0-4962-a91a-afad62ba2a21 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:23.675583 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-789933b3-0ee0-4962-a91a-afad62ba2a21 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:23.687431 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-789933b3-0ee0-4962-a91a-afad62ba2a21 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:23.688525 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-789933b3-0ee0-4962-a91a-afad62ba2a21 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:23.690111 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-789933b3-0ee0-4962-a91a-afad62ba2a21 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:23.691047 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-789933b3-0ee0-4962-a91a-afad62ba2a21 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:23.913926 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-789933b3-0ee0-4962-a91a-afad62ba2a21 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:23.923197 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-789933b3-0ee0-4962-a91a-afad62ba2a21 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1265 microversion: 2.1 time: 0.255655 May 10 17:51:23.924176 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 351/709] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:23 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:24.676886 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ed931cc5-6f0c-4541-a29d-f03bf11daa23 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:24.677588 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ed931cc5-6f0c-4541-a29d-f03bf11daa23 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:24.684547 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ed931cc5-6f0c-4541-a29d-f03bf11daa23 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:24.685011 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ed931cc5-6f0c-4541-a29d-f03bf11daa23 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:24.685800 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ed931cc5-6f0c-4541-a29d-f03bf11daa23 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:24.686247 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ed931cc5-6f0c-4541-a29d-f03bf11daa23 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:24.862021 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ed931cc5-6f0c-4541-a29d-f03bf11daa23 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:24.871782 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ed931cc5-6f0c-4541-a29d-f03bf11daa23 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1756 microversion: 2.1 time: 0.199179 May 10 17:51:24.872383 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 359/710] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:24 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1756 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:24.942638 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f7207c91-721c-473e-b83b-94918a7030c4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:24.943202 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f7207c91-721c-473e-b83b-94918a7030c4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:24.951252 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f7207c91-721c-473e-b83b-94918a7030c4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:24.951723 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f7207c91-721c-473e-b83b-94918a7030c4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:24.952511 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f7207c91-721c-473e-b83b-94918a7030c4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:24.952950 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f7207c91-721c-473e-b83b-94918a7030c4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:25.124067 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f7207c91-721c-473e-b83b-94918a7030c4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:25.132688 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f7207c91-721c-473e-b83b-94918a7030c4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1265 microversion: 2.1 time: 0.194792 May 10 17:51:25.133269 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 352/711] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:24 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:25.892595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1d8e2789-d970-4750-bc37-cff1c04effa0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:25.893228 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-1d8e2789-d970-4750-bc37-cff1c04effa0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:25.900621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1d8e2789-d970-4750-bc37-cff1c04effa0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:25.901070 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1d8e2789-d970-4750-bc37-cff1c04effa0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:25.901858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1d8e2789-d970-4750-bc37-cff1c04effa0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:25.902297 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1d8e2789-d970-4750-bc37-cff1c04effa0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:26.071251 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1d8e2789-d970-4750-bc37-cff1c04effa0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:26.086356 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-1d8e2789-d970-4750-bc37-cff1c04effa0 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1756 microversion: 2.1 time: 0.199775 May 10 17:51:26.087300 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 360/712] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:25 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:51:26.152741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ffda2df2-2fbe-4d55-b182-85be71e63859 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:26.153347 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ffda2df2-2fbe-4d55-b182-85be71e63859 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:26.160126 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ffda2df2-2fbe-4d55-b182-85be71e63859 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:26.160589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ffda2df2-2fbe-4d55-b182-85be71e63859 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:26.161386 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ffda2df2-2fbe-4d55-b182-85be71e63859 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:26.161831 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ffda2df2-2fbe-4d55-b182-85be71e63859 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:26.317579 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ffda2df2-2fbe-4d55-b182-85be71e63859 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:26.325861 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ffda2df2-2fbe-4d55-b182-85be71e63859 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1265 microversion: 2.1 time: 0.177726 May 10 17:51:26.326604 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 353/713] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:26 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:26.363065 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4f613a62-3a86-43b3-a29c-3aef795aac7f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:26.363633 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4f613a62-3a86-43b3-a29c-3aef795aac7f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:26.370941 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4f613a62-3a86-43b3-a29c-3aef795aac7f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:26.371474 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4f613a62-3a86-43b3-a29c-3aef795aac7f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:26.372258 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4f613a62-3a86-43b3-a29c-3aef795aac7f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:26.372690 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4f613a62-3a86-43b3-a29c-3aef795aac7f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:26.396558 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4f613a62-3a86-43b3-a29c-3aef795aac7f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50/ips" status: 200 len: 151 microversion: 2.1 time: 0.150631 May 10 17:51:26.397114 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 361/714] 10.222.0.60 () {58 vars in 1247 bytes} [Tue May 10 17:51:26 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50/ips => generated 151 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:51:26.408708 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-420be8f9-7168-47f5-a260-1ce868032830 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c70fbf62-000c-4eb9-9ac1-ecaac34cf13b"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:51:26.409745 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-420be8f9-7168-47f5-a260-1ce868032830 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:26.416189 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-420be8f9-7168-47f5-a260-1ce868032830 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:26.416634 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-420be8f9-7168-47f5-a260-1ce868032830 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:26.417395 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-420be8f9-7168-47f5-a260-1ce868032830 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:26.417830 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-420be8f9-7168-47f5-a260-1ce868032830 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:26.497518 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-420be8f9-7168-47f5-a260-1ce868032830 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] HTTP exception thrown: Invalid volume: volume c70fbf62-000c-4eb9-9ac1-ecaac34cf13b is already attached to instances: 35dc394b-a596-4f36-89cf-f60e42d697d1 May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-420be8f9-7168-47f5-a260-1ce868032830 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Request method failure captured: May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: POST /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50/os-volume_attachments HTTP/1.1 May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 74 May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqSO0xr7UIRxT3hXOmHxzovF69xIsGczVBDivdJOJBMJVORxiAfv56xQ3YabG87POPmQfFexgT58vToWwr1fhnRiMZA5-8wUr6OWagNr8GqdBYrkCpJLIa4vawh-qHLJ2BS3J-kASnH0YnEYJlsAV4sLiWMw7Cfpf3RSa_gKuZeEwB0 May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: f4e017a4040d450aad862065563ea64d May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:51:26.499267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:51:26.500896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4e017a4040d450aad862065563ea64d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4e017a4040d450aad862065563ea64d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}] May 10 17:51:26.500896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeNegativeTest-101320951 May 10 17:51:26.500896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: f4e017a4040d450aad862065563ea64d May 10 17:51:26.500896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:51:26.500896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:51:26.500896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:51:26.500896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:51:26.500896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: e6a99e5d684a48a2845d3379e7df812c May 10 17:51:26.500896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:51:26.500896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: May 10 17:51:26.500896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {"volumeAttachment": {"volumeId": "c70fbf62-000c-4eb9-9ac1-ecaac34cf13b"}} May 10 17:51:26.500896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:51:26.501733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Invalid volume: volume c70fbf62-000c-4eb9-9ac1-ecaac34cf13b is already attached to instances: 35dc394b-a596-4f36-89cf-f60e42d697d1 May 10 17:51:26.501733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'server_id': 'ab2c473c-6e44-4cb5-8ddb-128a2061ae50', 'body': {'volumeAttachment': {'volumeId': 'c70fbf62-000c-4eb9-9ac1-ecaac34cf13b'}}} May 10 17:51:26.501733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:51:26.501733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:51:26.501733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 17:51:26.501733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 17:51:26.501733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 17:51:26.501733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 17:51:26.501733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 17:51:26.501733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 17:51:26.501733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 17:51:26.501733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 17:51:26.501733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 17:51:26.501733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 17:51:26.501733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c70fbf62-000c-4eb9-9ac1-ecaac34cf13b is already attached to instances: 35dc394b-a596-4f36-89cf-f60e42d697d1 May 10 17:51:26.501733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:51:26.501733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:51:26.501733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:51:26.501733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c70fbf62-000c-4eb9-9ac1-ecaac34cf13b is already attached to instances: 35dc394b-a596-4f36-89cf-f60e42d697d1 May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:51:26.503045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:51:26.504516 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:51:26.504516 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:51:26.504516 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:51:26.504516 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c70fbf62-000c-4eb9-9ac1-ecaac34cf13b is already attached to instances: 35dc394b-a596-4f36-89cf-f60e42d697d1 May 10 17:51:26.504516 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:51:26.504516 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-420be8f9-7168-47f5-a260-1ce868032830 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Returning 400 to user: Invalid volume: volume c70fbf62-000c-4eb9-9ac1-ecaac34cf13b is already attached to instances: 35dc394b-a596-4f36-89cf-f60e42d697d1 {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:51:26.504516 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-420be8f9-7168-47f5-a260-1ce868032830 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "POST /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096099 May 10 17:51:26.504516 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 354/715] 10.222.0.60 () {60 vars in 1322 bytes} [Tue May 10 17:51:26 2022] POST /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 17:51:26.509971 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5c474d6b-7171-4331-bef5-21d08b59fe35 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:26.510460 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5c474d6b-7171-4331-bef5-21d08b59fe35 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:26.516452 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5c474d6b-7171-4331-bef5-21d08b59fe35 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:26.516900 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5c474d6b-7171-4331-bef5-21d08b59fe35 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:26.517658 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5c474d6b-7171-4331-bef5-21d08b59fe35 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:26.518091 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5c474d6b-7171-4331-bef5-21d08b59fe35 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:26.542737 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5c474d6b-7171-4331-bef5-21d08b59fe35 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Going to try to terminate instance {{(pid=123753) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:51:26.616968 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-5c474d6b-7171-4331-bef5-21d08b59fe35 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 204 len: 0 microversion: 2.1 time: 0.110578 May 10 17:51:26.617569 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 362/716] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:51:26 2022] DELETE /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:51:26.626199 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5a81fde1-7128-4c02-8b2d-83ddaedc35e3 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:26.626801 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5a81fde1-7128-4c02-8b2d-83ddaedc35e3 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:26.632795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a81fde1-7128-4c02-8b2d-83ddaedc35e3 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:26.633272 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a81fde1-7128-4c02-8b2d-83ddaedc35e3 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:26.634595 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a81fde1-7128-4c02-8b2d-83ddaedc35e3 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:26.635100 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a81fde1-7128-4c02-8b2d-83ddaedc35e3 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:26.765380 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5a81fde1-7128-4c02-8b2d-83ddaedc35e3 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:26.772855 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5a81fde1-7128-4c02-8b2d-83ddaedc35e3 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1682 microversion: 2.1 time: 0.150450 May 10 17:51:26.773404 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 355/717] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:26 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:27.105791 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-468ffd55-7f8e-4650-8c6f-11f4e01ab20e tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:27.107247 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-468ffd55-7f8e-4650-8c6f-11f4e01ab20e tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:27.113908 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-468ffd55-7f8e-4650-8c6f-11f4e01ab20e tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:27.114357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-468ffd55-7f8e-4650-8c6f-11f4e01ab20e tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:27.115151 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-468ffd55-7f8e-4650-8c6f-11f4e01ab20e tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:27.115631 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-468ffd55-7f8e-4650-8c6f-11f4e01ab20e tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:27.265919 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-468ffd55-7f8e-4650-8c6f-11f4e01ab20e tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:27.274565 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-468ffd55-7f8e-4650-8c6f-11f4e01ab20e tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1759 microversion: 2.1 time: 0.173187 May 10 17:51:27.275306 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 363/718] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:27 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1759 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:27.342893 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6fddf408-1a9f-459c-a4c0-9e691e8df4e6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:27.343488 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6fddf408-1a9f-459c-a4c0-9e691e8df4e6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:27.350257 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6fddf408-1a9f-459c-a4c0-9e691e8df4e6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:27.350707 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6fddf408-1a9f-459c-a4c0-9e691e8df4e6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:27.351522 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6fddf408-1a9f-459c-a4c0-9e691e8df4e6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:27.352871 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6fddf408-1a9f-459c-a4c0-9e691e8df4e6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:27.490693 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6fddf408-1a9f-459c-a4c0-9e691e8df4e6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:27.498525 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6fddf408-1a9f-459c-a4c0-9e691e8df4e6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1265 microversion: 2.1 time: 0.159745 May 10 17:51:27.499090 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 356/719] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:27 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:27.792328 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-604cad37-b4c3-4614-8059-6fa1fb924e68 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:27.792944 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-604cad37-b4c3-4614-8059-6fa1fb924e68 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:27.799096 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-604cad37-b4c3-4614-8059-6fa1fb924e68 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:27.799716 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-604cad37-b4c3-4614-8059-6fa1fb924e68 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:27.800499 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-604cad37-b4c3-4614-8059-6fa1fb924e68 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:27.800936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-604cad37-b4c3-4614-8059-6fa1fb924e68 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:27.928365 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-604cad37-b4c3-4614-8059-6fa1fb924e68 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:27.936403 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-604cad37-b4c3-4614-8059-6fa1fb924e68 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1682 microversion: 2.1 time: 0.148702 May 10 17:51:27.936960 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 364/720] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:27 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:28.515458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-000e02a0-88d8-4bd0-acae-6ac4f6df28a9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:28.516079 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-000e02a0-88d8-4bd0-acae-6ac4f6df28a9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:28.522328 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-000e02a0-88d8-4bd0-acae-6ac4f6df28a9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:28.522782 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-000e02a0-88d8-4bd0-acae-6ac4f6df28a9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:28.523604 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-000e02a0-88d8-4bd0-acae-6ac4f6df28a9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:28.524047 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-000e02a0-88d8-4bd0-acae-6ac4f6df28a9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:28.661250 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-000e02a0-88d8-4bd0-acae-6ac4f6df28a9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:28.669774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-000e02a0-88d8-4bd0-acae-6ac4f6df28a9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1265 microversion: 2.1 time: 0.158204 May 10 17:51:28.670348 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 357/721] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:28 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:28.954306 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-559c569a-d823-41be-9e1a-60fd8b5e1464 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:28.954950 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-559c569a-d823-41be-9e1a-60fd8b5e1464 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:28.961865 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-559c569a-d823-41be-9e1a-60fd8b5e1464 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:28.962505 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-559c569a-d823-41be-9e1a-60fd8b5e1464 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:28.963469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-559c569a-d823-41be-9e1a-60fd8b5e1464 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:28.963913 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-559c569a-d823-41be-9e1a-60fd8b5e1464 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:29.103232 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-559c569a-d823-41be-9e1a-60fd8b5e1464 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:29.110704 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-559c569a-d823-41be-9e1a-60fd8b5e1464 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1682 microversion: 2.1 time: 0.160311 May 10 17:51:29.111282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 365/722] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:28 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:29.686865 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f2f4f8e1-c755-4255-aefa-b8b5f50f4711 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:29.687498 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f2f4f8e1-c755-4255-aefa-b8b5f50f4711 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:29.694378 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f2f4f8e1-c755-4255-aefa-b8b5f50f4711 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:29.694914 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f2f4f8e1-c755-4255-aefa-b8b5f50f4711 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:29.698344 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f2f4f8e1-c755-4255-aefa-b8b5f50f4711 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:29.698344 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f2f4f8e1-c755-4255-aefa-b8b5f50f4711 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:29.936104 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f2f4f8e1-c755-4255-aefa-b8b5f50f4711 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:29.943754 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f2f4f8e1-c755-4255-aefa-b8b5f50f4711 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1265 microversion: 2.1 time: 0.260692 May 10 17:51:29.944426 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 358/723] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:29 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1265 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:30.128429 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4a000a32-c84a-4507-bf5e-4cae20a20660 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:30.129832 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4a000a32-c84a-4507-bf5e-4cae20a20660 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:30.137256 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4a000a32-c84a-4507-bf5e-4cae20a20660 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:30.138246 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4a000a32-c84a-4507-bf5e-4cae20a20660 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:30.139319 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4a000a32-c84a-4507-bf5e-4cae20a20660 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:30.140028 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4a000a32-c84a-4507-bf5e-4cae20a20660 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:30.376900 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4a000a32-c84a-4507-bf5e-4cae20a20660 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:30.388500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-ec9caa97-dce1-4cd8-b53c-fd8fb2095e27 req-4a7b77b8-dde2-4ade-b02a-38eaa0ea5e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab2c473c-6e44-4cb5-8ddb-128a2061ae50", "name": "network-vif-deleted", "tag": "9eecfcd3-4266-44a2-966e-218d7a2c006e"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:51:30.401648 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-ec9caa97-dce1-4cd8-b53c-fd8fb2095e27 req-4a7b77b8-dde2-4ade-b02a-38eaa0ea5e4f service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:30.402117 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-ec9caa97-dce1-4cd8-b53c-fd8fb2095e27 req-4a7b77b8-dde2-4ade-b02a-38eaa0ea5e4f service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:30.402810 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4a000a32-c84a-4507-bf5e-4cae20a20660 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1615 microversion: 2.1 time: 0.275539 May 10 17:51:30.403428 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 366/724] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:30 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1615 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:30.416675 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-ec9caa97-dce1-4cd8-b53c-fd8fb2095e27 req-4a7b77b8-dde2-4ade-b02a-38eaa0ea5e4f service nova] Creating event network-vif-deleted:9eecfcd3-4266-44a2-966e-218d7a2c006e for instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 on hv-cinder-84130 May 10 17:51:30.422051 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-ec9caa97-dce1-4cd8-b53c-fd8fb2095e27 req-4a7b77b8-dde2-4ade-b02a-38eaa0ea5e4f service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037127 May 10 17:51:30.422640 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 359/725] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:51:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:51:30.962850 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-51f8f826-835b-4da8-8935-0dc8436b2cf5 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:30.963723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-51f8f826-835b-4da8-8935-0dc8436b2cf5 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:30.972593 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-51f8f826-835b-4da8-8935-0dc8436b2cf5 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:30.972974 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-51f8f826-835b-4da8-8935-0dc8436b2cf5 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:30.973870 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-51f8f826-835b-4da8-8935-0dc8436b2cf5 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:30.974773 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-51f8f826-835b-4da8-8935-0dc8436b2cf5 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:31.174826 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-51f8f826-835b-4da8-8935-0dc8436b2cf5 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:31.188388 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-51f8f826-835b-4da8-8935-0dc8436b2cf5 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1265 microversion: 2.1 time: 0.229805 May 10 17:51:31.189597 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 367/726] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:30 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:31.425774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-21661421-8b0a-4fba-b98f-370b3a471aaa tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:31.426482 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-21661421-8b0a-4fba-b98f-370b3a471aaa tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:31.435080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-21661421-8b0a-4fba-b98f-370b3a471aaa tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:31.435744 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-21661421-8b0a-4fba-b98f-370b3a471aaa tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:31.436521 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-21661421-8b0a-4fba-b98f-370b3a471aaa tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:31.437118 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-21661421-8b0a-4fba-b98f-370b3a471aaa tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:31.477439 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-21661421-8b0a-4fba-b98f-370b3a471aaa tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:31.477993 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-21661421-8b0a-4fba-b98f-370b3a471aaa tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:31.478566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-21661421-8b0a-4fba-b98f-370b3a471aaa tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lazy-loading 'fault' on Instance uuid ab2c473c-6e44-4cb5-8ddb-128a2061ae50 {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:51:31.525884 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-21661421-8b0a-4fba-b98f-370b3a471aaa tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:31.533844 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-21661421-8b0a-4fba-b98f-370b3a471aaa tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 200 len: 1331 microversion: 2.1 time: 0.116782 May 10 17:51:31.534428 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 360/727] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:31 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:51:31.661464 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:51:31.661780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Tue May 10 17:51:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:51:32.206381 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-0d72301f-3ccf-4bfd-aab2-68d5df629ca6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:32.207202 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-0d72301f-3ccf-4bfd-aab2-68d5df629ca6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:32.215196 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0d72301f-3ccf-4bfd-aab2-68d5df629ca6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:32.215668 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0d72301f-3ccf-4bfd-aab2-68d5df629ca6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:32.216462 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0d72301f-3ccf-4bfd-aab2-68d5df629ca6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:32.216938 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0d72301f-3ccf-4bfd-aab2-68d5df629ca6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:32.396790 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-0d72301f-3ccf-4bfd-aab2-68d5df629ca6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:32.412439 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-0d72301f-3ccf-4bfd-aab2-68d5df629ca6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1265 microversion: 2.1 time: 0.210110 May 10 17:51:32.413374 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 368/728] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:32 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:51:32.552488 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cfc42d44-af4f-4fe8-9327-02cf1d1cfc0f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:32.553718 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cfc42d44-af4f-4fe8-9327-02cf1d1cfc0f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:32.561644 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cfc42d44-af4f-4fe8-9327-02cf1d1cfc0f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:32.562117 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cfc42d44-af4f-4fe8-9327-02cf1d1cfc0f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:32.562908 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cfc42d44-af4f-4fe8-9327-02cf1d1cfc0f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:32.563351 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cfc42d44-af4f-4fe8-9327-02cf1d1cfc0f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:32.579283 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-cfc42d44-af4f-4fe8-9327-02cf1d1cfc0f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] HTTP exception thrown: Instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 could not be found. May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cfc42d44-af4f-4fe8-9327-02cf1d1cfc0f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Request method failure captured: May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 HTTP/1.1 May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqSO0xr7UIRxT3hXOmHxzovF69xIsGczVBDivdJOJBMJVORxiAfv56xQ3YabG87POPmQfFexgT58vToWwr1fhnRiMZA5-8wUr6OWagNr8GqdBYrkCpJLIa4vawh-qHLJ2BS3J-kASnH0YnEYJlsAV4sLiWMw7Cfpf3RSa_gKuZeEwB0 May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: f4e017a4040d450aad862065563ea64d May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:51:32.580985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:51:32.582378 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4e017a4040d450aad862065563ea64d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4e017a4040d450aad862065563ea64d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}] May 10 17:51:32.582378 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeNegativeTest-101320951 May 10 17:51:32.582378 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: f4e017a4040d450aad862065563ea64d May 10 17:51:32.582378 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:51:32.582378 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:51:32.582378 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:51:32.582378 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:51:32.582378 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: e6a99e5d684a48a2845d3379e7df812c May 10 17:51:32.582378 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:51:32.582378 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:51:32.582378 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 could not be found. May 10 17:51:32.582378 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': 'ab2c473c-6e44-4cb5-8ddb-128a2061ae50'} May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 could not be found. May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:51:32.583163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:51:32.584566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:51:32.584566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:51:32.584566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:51:32.584566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:51:32.584566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:51:32.584566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:51:32.584566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:51:32.584566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 could not be found. May 10 17:51:32.584566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:51:32.584566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:51:32.584566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:51:32.584566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:51:32.584566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:51:32.584566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:51:32.584566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:51:32.584566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:51:32.584566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 could not be found. May 10 17:51:32.584566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:51:32.585705 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cfc42d44-af4f-4fe8-9327-02cf1d1cfc0f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Returning 404 to user: Instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:51:32.585705 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cfc42d44-af4f-4fe8-9327-02cf1d1cfc0f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 404 len: 111 microversion: 2.1 time: 0.033883 May 10 17:51:32.585705 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 361/729] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:32 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:51:32.593398 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e912f1e2-c850-47e7-a1fa-ae707f10e70b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '.version_select at 0x7f3e768a93a0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:32.616546 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e912f1e2-c850-47e7-a1fa-ae707f10e70b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1115855894" status: 202 len: 0 microversion: 2.1 time: 0.026966 May 10 17:51:32.617353 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 369/730] 10.222.0.60 () {58 vars in 1220 bytes} [Tue May 10 17:51:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1115855894 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:51:33.377522 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1f428ec3-adc9-4b60-9a38-c5001fb46ea0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:33.377941 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1f428ec3-adc9-4b60-9a38-c5001fb46ea0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:33.384304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1f428ec3-adc9-4b60-9a38-c5001fb46ea0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:33.384772 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1f428ec3-adc9-4b60-9a38-c5001fb46ea0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:33.385571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1f428ec3-adc9-4b60-9a38-c5001fb46ea0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:33.386013 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1f428ec3-adc9-4b60-9a38-c5001fb46ea0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:33.429971 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-d855f598-3a01-4b07-bb0b-4ddbc71c56e9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:33.430621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-d855f598-3a01-4b07-bb0b-4ddbc71c56e9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:33.437203 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d855f598-3a01-4b07-bb0b-4ddbc71c56e9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:33.437666 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d855f598-3a01-4b07-bb0b-4ddbc71c56e9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:33.438544 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d855f598-3a01-4b07-bb0b-4ddbc71c56e9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:33.439031 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d855f598-3a01-4b07-bb0b-4ddbc71c56e9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:33.469211 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-1f428ec3-adc9-4b60-9a38-c5001fb46ea0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lazy-loading 'services' on Instance uuid 35dc394b-a596-4f36-89cf-f60e42d697d1 {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:51:33.541975 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1f428ec3-adc9-4b60-9a38-c5001fb46ea0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "DELETE /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1/os-volume_attachments/c70fbf62-000c-4eb9-9ac1-ecaac34cf13b" status: 202 len: 0 microversion: 2.1 time: 0.168265 May 10 17:51:33.542517 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 362/731] 10.222.0.60 () {58 vars in 1415 bytes} [Tue May 10 17:51:33 2022] DELETE /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1/os-volume_attachments/c70fbf62-000c-4eb9-9ac1-ecaac34cf13b => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:51:33.551447 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-57837219-74c2-4f7a-a59f-e17444637b84 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:33.552528 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-57837219-74c2-4f7a-a59f-e17444637b84 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:33.560417 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-57837219-74c2-4f7a-a59f-e17444637b84 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:33.560870 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-57837219-74c2-4f7a-a59f-e17444637b84 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:33.561697 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-57837219-74c2-4f7a-a59f-e17444637b84 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:33.562178 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-57837219-74c2-4f7a-a59f-e17444637b84 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:33.580827 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-d855f598-3a01-4b07-bb0b-4ddbc71c56e9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:33.590533 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-d855f598-3a01-4b07-bb0b-4ddbc71c56e9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1265 microversion: 2.1 time: 0.164789 May 10 17:51:33.592065 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 370/732] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:33 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:33.595916 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-57837219-74c2-4f7a-a59f-e17444637b84 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048803 May 10 17:51:33.596693 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 363/733] 10.222.0.60 () {58 vars in 1301 bytes} [Tue May 10 17:51:33 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:51:34.608739 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1ebe21f9-d83d-4af2-8d41-702fd0f13316 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:34.609558 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a3e076e2-c8ea-4e00-a375-ce1ff2c5c540 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:34.609948 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-1ebe21f9-d83d-4af2-8d41-702fd0f13316 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:34.610179 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a3e076e2-c8ea-4e00-a375-ce1ff2c5c540 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:34.616862 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1ebe21f9-d83d-4af2-8d41-702fd0f13316 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:34.617198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a3e076e2-c8ea-4e00-a375-ce1ff2c5c540 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:34.617494 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1ebe21f9-d83d-4af2-8d41-702fd0f13316 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:34.618215 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a3e076e2-c8ea-4e00-a375-ce1ff2c5c540 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:34.618985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a3e076e2-c8ea-4e00-a375-ce1ff2c5c540 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:34.619471 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a3e076e2-c8ea-4e00-a375-ce1ff2c5c540 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:34.619686 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1ebe21f9-d83d-4af2-8d41-702fd0f13316 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:34.620040 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1ebe21f9-d83d-4af2-8d41-702fd0f13316 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:34.658867 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-1ebe21f9-d83d-4af2-8d41-702fd0f13316 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054116 May 10 17:51:34.664241 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 371/734] 10.222.0.60 () {58 vars in 1301 bytes} [Tue May 10 17:51:34 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:51:34.731260 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c8814064-a03f-4ead-b225-485966fad3a2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:34.731810 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c8814064-a03f-4ead-b225-485966fad3a2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:34.738696 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c8814064-a03f-4ead-b225-485966fad3a2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:34.739160 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c8814064-a03f-4ead-b225-485966fad3a2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:34.740175 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c8814064-a03f-4ead-b225-485966fad3a2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:34.740593 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c8814064-a03f-4ead-b225-485966fad3a2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:34.766597 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c8814064-a03f-4ead-b225-485966fad3a2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Going to try to terminate instance {{(pid=123753) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:51:34.770485 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a3e076e2-c8ea-4e00-a375-ce1ff2c5c540 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:34.778601 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a3e076e2-c8ea-4e00-a375-ce1ff2c5c540 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1265 microversion: 2.1 time: 0.173146 May 10 17:51:34.779315 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 364/735] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:34 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:51:34.843266 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c8814064-a03f-4ead-b225-485966fad3a2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "DELETE /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 204 len: 0 microversion: 2.1 time: 0.116254 May 10 17:51:34.844279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 372/736] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:51:34 2022] DELETE /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 17:51:34.854262 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f4b40a3c-0fba-4242-b316-7d0c85aebef6 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:34.854870 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f4b40a3c-0fba-4242-b316-7d0c85aebef6 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:34.860784 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f4b40a3c-0fba-4242-b316-7d0c85aebef6 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:34.861234 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f4b40a3c-0fba-4242-b316-7d0c85aebef6 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:34.861996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f4b40a3c-0fba-4242-b316-7d0c85aebef6 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:34.862434 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f4b40a3c-0fba-4242-b316-7d0c85aebef6 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:34.995266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f4b40a3c-0fba-4242-b316-7d0c85aebef6 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:35.003116 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f4b40a3c-0fba-4242-b316-7d0c85aebef6 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1680 microversion: 2.1 time: 0.154374 May 10 17:51:35.003709 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 365/737] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:34 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:35.798124 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-57a6923d-7a8f-4ba3-ad19-d3ac36c386ee tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:35.798996 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-57a6923d-7a8f-4ba3-ad19-d3ac36c386ee tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:35.806303 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-57a6923d-7a8f-4ba3-ad19-d3ac36c386ee tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:35.806765 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-57a6923d-7a8f-4ba3-ad19-d3ac36c386ee tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:35.807596 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-57a6923d-7a8f-4ba3-ad19-d3ac36c386ee tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:35.808044 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-57a6923d-7a8f-4ba3-ad19-d3ac36c386ee tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:35.951313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-57a6923d-7a8f-4ba3-ad19-d3ac36c386ee tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:35.958922 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-57a6923d-7a8f-4ba3-ad19-d3ac36c386ee tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1265 microversion: 2.1 time: 0.165105 May 10 17:51:35.959512 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 373/738] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:35 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:36.021207 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ff35852b-938f-4393-a595-84e830122dfb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:36.021816 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ff35852b-938f-4393-a595-84e830122dfb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:36.029270 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ff35852b-938f-4393-a595-84e830122dfb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:36.029724 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ff35852b-938f-4393-a595-84e830122dfb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:36.030506 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ff35852b-938f-4393-a595-84e830122dfb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:36.030941 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ff35852b-938f-4393-a595-84e830122dfb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:36.271995 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ff35852b-938f-4393-a595-84e830122dfb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:36.284431 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ff35852b-938f-4393-a595-84e830122dfb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1680 microversion: 2.1 time: 0.266627 May 10 17:51:36.285438 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 366/739] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:36 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1680 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:36.733341 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-421ea6cb-cf2d-4b09-a7c7-33a45fc09522 req-fff4cb18-2878-418b-89f6-c680626d5869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55760f67-2403-45c9-8db7-d5ae5f45c366", "name": "network-vif-plugged", "status": "completed", "tag": "d083dfb1-18c3-4ce4-aee5-72cf745b342b"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:51:36.744562 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-421ea6cb-cf2d-4b09-a7c7-33a45fc09522 req-fff4cb18-2878-418b-89f6-c680626d5869 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:36.745039 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-421ea6cb-cf2d-4b09-a7c7-33a45fc09522 req-fff4cb18-2878-418b-89f6-c680626d5869 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:36.758686 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-421ea6cb-cf2d-4b09-a7c7-33a45fc09522 req-fff4cb18-2878-418b-89f6-c680626d5869 service nova] Creating event network-vif-plugged:d083dfb1-18c3-4ce4-aee5-72cf745b342b for instance 55760f67-2403-45c9-8db7-d5ae5f45c366 on hv-cinder-84130 May 10 17:51:36.764553 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-421ea6cb-cf2d-4b09-a7c7-33a45fc09522 req-fff4cb18-2878-418b-89f6-c680626d5869 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038461 May 10 17:51:36.765315 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 374/740] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:51:36.976414 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-dde966f4-f3b0-45c3-b3c0-435bfdc6cc72 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:36.978880 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-dde966f4-f3b0-45c3-b3c0-435bfdc6cc72 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:36.995948 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dde966f4-f3b0-45c3-b3c0-435bfdc6cc72 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:36.997360 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dde966f4-f3b0-45c3-b3c0-435bfdc6cc72 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:36.998369 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dde966f4-f3b0-45c3-b3c0-435bfdc6cc72 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:36.998985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dde966f4-f3b0-45c3-b3c0-435bfdc6cc72 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:37.032631 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-5f5ac512-a3b3-4b30-9e3f-3225ff6ff716 req-3eadb175-fabe-445d-8c52-c889b340d602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35dc394b-a596-4f36-89cf-f60e42d697d1", "name": "network-vif-deleted", "tag": "6f6bce01-999d-439d-8315-53c87197c824"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:51:37.054514 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-5f5ac512-a3b3-4b30-9e3f-3225ff6ff716 req-3eadb175-fabe-445d-8c52-c889b340d602 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:37.055811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-5f5ac512-a3b3-4b30-9e3f-3225ff6ff716 req-3eadb175-fabe-445d-8c52-c889b340d602 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:37.072810 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-5f5ac512-a3b3-4b30-9e3f-3225ff6ff716 req-3eadb175-fabe-445d-8c52-c889b340d602 service nova] Creating event network-vif-deleted:6f6bce01-999d-439d-8315-53c87197c824 for instance 35dc394b-a596-4f36-89cf-f60e42d697d1 on hv-cinder-84130 May 10 17:51:37.079096 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-5f5ac512-a3b3-4b30-9e3f-3225ff6ff716 req-3eadb175-fabe-445d-8c52-c889b340d602 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056424 May 10 17:51:37.080225 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 375/741] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:51:37.261685 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-dde966f4-f3b0-45c3-b3c0-435bfdc6cc72 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:37.269994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-dde966f4-f3b0-45c3-b3c0-435bfdc6cc72 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1265 microversion: 2.1 time: 0.297595 May 10 17:51:37.270777 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 367/742] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:36 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1265 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:37.303040 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fc107f81-8292-4f29-bffa-439f5aad9b7b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:37.303819 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-fc107f81-8292-4f29-bffa-439f5aad9b7b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:37.313931 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fc107f81-8292-4f29-bffa-439f5aad9b7b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:37.314796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fc107f81-8292-4f29-bffa-439f5aad9b7b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:37.316226 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fc107f81-8292-4f29-bffa-439f5aad9b7b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:37.317060 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fc107f81-8292-4f29-bffa-439f5aad9b7b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:37.370041 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fc107f81-8292-4f29-bffa-439f5aad9b7b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:37.370981 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fc107f81-8292-4f29-bffa-439f5aad9b7b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:37.371831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.objects.instance [None req-fc107f81-8292-4f29-bffa-439f5aad9b7b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lazy-loading 'fault' on Instance uuid 35dc394b-a596-4f36-89cf-f60e42d697d1 {{(pid=123753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:51:37.428820 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fc107f81-8292-4f29-bffa-439f5aad9b7b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:37.437869 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-fc107f81-8292-4f29-bffa-439f5aad9b7b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1329 microversion: 2.1 time: 0.139263 May 10 17:51:37.438459 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 376/743] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:37 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1329 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:38.287655 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c22ab7bc-3a4d-486f-9e07-b5bee1eae13d tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:38.288270 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c22ab7bc-3a4d-486f-9e07-b5bee1eae13d tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:38.294945 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c22ab7bc-3a4d-486f-9e07-b5bee1eae13d tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:38.295421 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c22ab7bc-3a4d-486f-9e07-b5bee1eae13d tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:38.296211 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c22ab7bc-3a4d-486f-9e07-b5bee1eae13d tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:38.296655 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c22ab7bc-3a4d-486f-9e07-b5bee1eae13d tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:38.439312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c22ab7bc-3a4d-486f-9e07-b5bee1eae13d tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:38.447841 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c22ab7bc-3a4d-486f-9e07-b5bee1eae13d tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1265 microversion: 2.1 time: 0.163737 May 10 17:51:38.448423 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 368/744] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:38 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:38.467512 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-602311e0-f083-48ab-b2a0-a7865e1ed068 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:38.468145 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-602311e0-f083-48ab-b2a0-a7865e1ed068 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:38.474714 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-602311e0-f083-48ab-b2a0-a7865e1ed068 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:38.475169 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-602311e0-f083-48ab-b2a0-a7865e1ed068 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:38.475983 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-602311e0-f083-48ab-b2a0-a7865e1ed068 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:38.476426 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-602311e0-f083-48ab-b2a0-a7865e1ed068 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:38.509027 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-602311e0-f083-48ab-b2a0-a7865e1ed068 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:38.509390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-602311e0-f083-48ab-b2a0-a7865e1ed068 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:38.509851 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.objects.instance [None req-602311e0-f083-48ab-b2a0-a7865e1ed068 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lazy-loading 'fault' on Instance uuid 35dc394b-a596-4f36-89cf-f60e42d697d1 {{(pid=123753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:51:38.551440 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-602311e0-f083-48ab-b2a0-a7865e1ed068 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:38.560776 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-602311e0-f083-48ab-b2a0-a7865e1ed068 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 200 len: 1329 microversion: 2.1 time: 0.098121 May 10 17:51:38.561378 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 377/745] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:38 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 1329 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:51:39.465504 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9e717bc7-ce3e-4cc3-8c35-96faf009984a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:39.466230 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9e717bc7-ce3e-4cc3-8c35-96faf009984a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:39.472818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9e717bc7-ce3e-4cc3-8c35-96faf009984a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:39.473263 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9e717bc7-ce3e-4cc3-8c35-96faf009984a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:39.474046 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9e717bc7-ce3e-4cc3-8c35-96faf009984a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:39.474485 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9e717bc7-ce3e-4cc3-8c35-96faf009984a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:39.580045 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-917bb672-dbd1-4299-b85b-0da682dd01f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:39.580756 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-917bb672-dbd1-4299-b85b-0da682dd01f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:39.590892 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-917bb672-dbd1-4299-b85b-0da682dd01f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:39.592086 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-917bb672-dbd1-4299-b85b-0da682dd01f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:39.593731 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-917bb672-dbd1-4299-b85b-0da682dd01f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:39.594770 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-917bb672-dbd1-4299-b85b-0da682dd01f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:39.617178 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-917bb672-dbd1-4299-b85b-0da682dd01f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] HTTP exception thrown: Instance 35dc394b-a596-4f36-89cf-f60e42d697d1 could not be found. May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-917bb672-dbd1-4299-b85b-0da682dd01f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Request method failure captured: May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 HTTP/1.1 May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqSO0xr7UIRxT3hXOmHxzovF69xIsGczVBDivdJOJBMJVORxiAfv56xQ3YabG87POPmQfFexgT58vToWwr1fhnRiMZA5-8wUr6OWagNr8GqdBYrkCpJLIa4vawh-qHLJ2BS3J-kASnH0YnEYJlsAV4sLiWMw7Cfpf3RSa_gKuZeEwB0 May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: f4e017a4040d450aad862065563ea64d May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:51:39.619880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:51:39.621428 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4e017a4040d450aad862065563ea64d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4e017a4040d450aad862065563ea64d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}] May 10 17:51:39.621428 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-AttachVolumeNegativeTest-101320951 May 10 17:51:39.621428 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: f4e017a4040d450aad862065563ea64d May 10 17:51:39.621428 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:51:39.621428 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:51:39.621428 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:51:39.621428 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:51:39.621428 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: e6a99e5d684a48a2845d3379e7df812c May 10 17:51:39.621428 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:51:39.621428 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:51:39.621428 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance 35dc394b-a596-4f36-89cf-f60e42d697d1 could not be found. May 10 17:51:39.621428 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': '35dc394b-a596-4f36-89cf-f60e42d697d1'} May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35dc394b-a596-4f36-89cf-f60e42d697d1 could not be found. May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:51:39.622279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:51:39.623648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:51:39.623648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:51:39.623648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:51:39.623648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:51:39.623648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:51:39.623648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:51:39.623648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:51:39.623648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35dc394b-a596-4f36-89cf-f60e42d697d1 could not be found. May 10 17:51:39.623648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:51:39.623648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:51:39.623648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:51:39.623648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:51:39.623648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:51:39.623648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:51:39.623648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:51:39.623648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:51:39.623648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35dc394b-a596-4f36-89cf-f60e42d697d1 could not be found. May 10 17:51:39.623648 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:51:39.625783 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-917bb672-dbd1-4299-b85b-0da682dd01f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Returning 404 to user: Instance 35dc394b-a596-4f36-89cf-f60e42d697d1 could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:51:39.626683 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-917bb672-dbd1-4299-b85b-0da682dd01f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 404 len: 111 microversion: 2.1 time: 0.051957 May 10 17:51:39.630975 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 378/746] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:39 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 17:51:39.636658 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8ba1847d-f15e-4602-89ca-09b892342b3d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '.version_select at 0x7f3e7baa3310>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:39.659755 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8ba1847d-f15e-4602-89ca-09b892342b3d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-93431245" status: 202 len: 0 microversion: 2.1 time: 0.027119 May 10 17:51:39.660356 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 379/747] 10.222.0.60 () {58 vars in 1214 bytes} [Tue May 10 17:51:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-93431245 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:51:39.852842 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9e717bc7-ce3e-4cc3-8c35-96faf009984a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:39.860253 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9e717bc7-ce3e-4cc3-8c35-96faf009984a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1451 microversion: 2.1 time: 0.399566 May 10 17:51:39.860847 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 369/748] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:39 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1451 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:39.877381 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e31c7ba2-c868-426d-a539-25b24d54d38a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:39.877994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e31c7ba2-c868-426d-a539-25b24d54d38a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:39.886896 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e31c7ba2-c868-426d-a539-25b24d54d38a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:39.887416 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e31c7ba2-c868-426d-a539-25b24d54d38a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:39.888305 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e31c7ba2-c868-426d-a539-25b24d54d38a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:39.889004 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e31c7ba2-c868-426d-a539-25b24d54d38a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:40.067776 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e31c7ba2-c868-426d-a539-25b24d54d38a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:40.075917 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e31c7ba2-c868-426d-a539-25b24d54d38a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1451 microversion: 2.1 time: 0.202470 May 10 17:51:40.076489 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 380/749] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:39 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1451 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:40.451322 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bc3fad71-bbe2-40aa-b654-d42a165183fb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Action: 'create', calling method: .version_select at 0x7f3e7bac9670>, body: {"keypair": {"name": "tempest-keypair-1051743302", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNp+Y/mVUJuwY09p3oamqX3njuRScjEgeSmG+cJmohO0/07L+9Mg/ZUgCjhQ+yQyFWxSj8T+yHtQiqk6Xbrhwhmed7xVh7NDDYo0UDpQAmzRuKb1zuE8zHql6ChZ1HrC6g=="}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:51:40.466376 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-bc3fad71-bbe2-40aa-b654-d42a165183fb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Getting quotas for project f4e017a4040d450aad862065563ea64d. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:51:40.470721 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-bc3fad71-bbe2-40aa-b654-d42a165183fb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Getting quotas for user e6a99e5d684a48a2845d3379e7df812c and project f4e017a4040d450aad862065563ea64d. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:51:40.501604 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bc3fad71-bbe2-40aa-b654-d42a165183fb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055766 May 10 17:51:40.502121 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 370/750] 10.222.0.60 () {60 vars in 1158 bytes} [Tue May 10 17:51:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:51:42.137374 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4b79cae8-bc80-4e58-be19-97184837777b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-318991018", "imageRef": "a7737c62-8029-44aa-8da7-e46fea7607fb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a13d84d-c9e9-413f-a254-ca6edab95c78"}], "security_groups": [{"name": "tempest-securitygroup--1822465812"}], "key_name": "tempest-keypair-1051743302", "user_data": "}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:51:42.211549 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-5afd9397-80c7-49dd-8333-0a7f91e7c4f6 req-3222957b-96ab-46a9-bdfd-3afcbd916c18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55760f67-2403-45c9-8db7-d5ae5f45c366", "tag": "d083dfb1-18c3-4ce4-aee5-72cf745b342b"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:51:42.220744 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-5afd9397-80c7-49dd-8333-0a7f91e7c4f6 req-3222957b-96ab-46a9-bdfd-3afcbd916c18 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:42.221602 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-5afd9397-80c7-49dd-8333-0a7f91e7c4f6 req-3222957b-96ab-46a9-bdfd-3afcbd916c18 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:42.234277 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-5afd9397-80c7-49dd-8333-0a7f91e7c4f6 req-3222957b-96ab-46a9-bdfd-3afcbd916c18 service nova] Creating event network-changed:d083dfb1-18c3-4ce4-aee5-72cf745b342b for instance 55760f67-2403-45c9-8db7-d5ae5f45c366 on hv-cinder-84130 May 10 17:51:42.240451 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-5afd9397-80c7-49dd-8333-0a7f91e7c4f6 req-3222957b-96ab-46a9-bdfd-3afcbd916c18 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033185 May 10 17:51:42.241605 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 371/751] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:51:42.266766 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.network.neutron [None req-4b79cae8-bc80-4e58-be19-97184837777b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] validate_networks() for [('5a13d84d-c9e9-413f-a254-ca6edab95c78', None, None, None, None, None)] {{(pid=123753) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:51:43.382453 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-4b79cae8-bc80-4e58-be19-97184837777b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Flavor limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:51:43.383689 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-4b79cae8-bc80-4e58-be19-97184837777b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Image limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:51:43.384683 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-4b79cae8-bc80-4e58-be19-97184837777b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Flavor pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:51:43.385574 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-4b79cae8-bc80-4e58-be19-97184837777b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Image pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:51:43.386449 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-4b79cae8-bc80-4e58-be19-97184837777b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:51:43.402507 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4b79cae8-bc80-4e58-be19-97184837777b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:43.402979 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4b79cae8-bc80-4e58-be19-97184837777b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:43.403850 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4b79cae8-bc80-4e58-be19-97184837777b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:43.404291 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4b79cae8-bc80-4e58-be19-97184837777b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:43.424357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-4b79cae8-bc80-4e58-be19-97184837777b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Getting quotas for project f4e017a4040d450aad862065563ea64d. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:51:43.429043 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-4b79cae8-bc80-4e58-be19-97184837777b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Getting quotas for user e6a99e5d684a48a2845d3379e7df812c and project f4e017a4040d450aad862065563ea64d. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:51:43.445223 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4b79cae8-bc80-4e58-be19-97184837777b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Going to run 1 instances... {{(pid=123753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:51:43.452118 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4b79cae8-bc80-4e58-be19-97184837777b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7737c62-8029-44aa-8da7-e46fea7607fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:51:43.529672 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4b79cae8-bc80-4e58-be19-97184837777b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.398518 May 10 17:51:43.530712 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 381/752] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 17:51:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:51:43.542209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e2f66a9f-3fb6-4dad-aada-6999f78ea8ca tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:43.543772 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e2f66a9f-3fb6-4dad-aada-6999f78ea8ca tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:43.645597 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e2f66a9f-3fb6-4dad-aada-6999f78ea8ca tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:43.662428 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e2f66a9f-3fb6-4dad-aada-6999f78ea8ca tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 200 len: 1241 microversion: 2.1 time: 0.124872 May 10 17:51:43.663478 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 372/753] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:43 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 1241 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:44.177348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-54628dd3-2af8-49eb-a4da-0453d246f04e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:44.177836 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-54628dd3-2af8-49eb-a4da-0453d246f04e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:44.184674 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-54628dd3-2af8-49eb-a4da-0453d246f04e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:44.185129 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-54628dd3-2af8-49eb-a4da-0453d246f04e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:44.185921 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-54628dd3-2af8-49eb-a4da-0453d246f04e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:44.186355 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-54628dd3-2af8-49eb-a4da-0453d246f04e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:44.225893 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-54628dd3-2af8-49eb-a4da-0453d246f04e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/os-volume_attachments/1975070b-d0ce-40e8-9051-e9cb8df171af" status: 200 len: 194 microversion: 2.20 time: 0.052633 May 10 17:51:44.226839 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 382/754] 10.222.0.60 () {60 vars in 1453 bytes} [Tue May 10 17:51:44 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/os-volume_attachments/1975070b-d0ce-40e8-9051-e9cb8df171af => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:51:44.298530 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a3344fbf-ecc1-4d7a-af14-7260545b9c89 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:44.299038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a3344fbf-ecc1-4d7a-af14-7260545b9c89 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:44.309472 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a3344fbf-ecc1-4d7a-af14-7260545b9c89 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:44.309928 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a3344fbf-ecc1-4d7a-af14-7260545b9c89 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:44.310721 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a3344fbf-ecc1-4d7a-af14-7260545b9c89 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:44.311284 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a3344fbf-ecc1-4d7a-af14-7260545b9c89 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:44.403351 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-a3344fbf-ecc1-4d7a-af14-7260545b9c89 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lazy-loading 'services' on Instance uuid 4006eed6-2338-46b7-9133-e5c3fdead35c {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:51:44.477232 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a3344fbf-ecc1-4d7a-af14-7260545b9c89 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/os-volume_attachments/1975070b-d0ce-40e8-9051-e9cb8df171af" status: 202 len: 0 microversion: 2.20 time: 0.182689 May 10 17:51:44.477715 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 373/755] 10.222.0.60 () {60 vars in 1456 bytes} [Tue May 10 17:51:44 2022] DELETE /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/os-volume_attachments/1975070b-d0ce-40e8-9051-e9cb8df171af => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 10 17:51:44.486217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-48d01889-41b5-44a3-af59-bd062d936d67 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:44.487220 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-48d01889-41b5-44a3-af59-bd062d936d67 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:44.494797 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-48d01889-41b5-44a3-af59-bd062d936d67 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:44.495247 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-48d01889-41b5-44a3-af59-bd062d936d67 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:44.496086 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-48d01889-41b5-44a3-af59-bd062d936d67 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:44.496527 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-48d01889-41b5-44a3-af59-bd062d936d67 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:44.529008 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-48d01889-41b5-44a3-af59-bd062d936d67 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046708 May 10 17:51:44.529778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 383/756] 10.222.0.60 () {60 vars in 1342 bytes} [Tue May 10 17:51:44 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 10 17:51:44.696481 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f0ab9729-15c6-43f1-872f-e0496c22534f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:44.698155 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f0ab9729-15c6-43f1-872f-e0496c22534f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:44.712170 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f0ab9729-15c6-43f1-872f-e0496c22534f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:44.713524 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f0ab9729-15c6-43f1-872f-e0496c22534f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:44.715529 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f0ab9729-15c6-43f1-872f-e0496c22534f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:44.716694 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f0ab9729-15c6-43f1-872f-e0496c22534f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:44.828078 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f0ab9729-15c6-43f1-872f-e0496c22534f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:44.838169 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f0ab9729-15c6-43f1-872f-e0496c22534f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 200 len: 1301 microversion: 2.1 time: 0.154802 May 10 17:51:44.838871 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 374/757] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:44 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 1301 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:45.542225 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4c436239-5658-49dc-8ea3-95714f844329 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:45.543184 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4c436239-5658-49dc-8ea3-95714f844329 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:45.550065 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4c436239-5658-49dc-8ea3-95714f844329 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:45.550520 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4c436239-5658-49dc-8ea3-95714f844329 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:45.551309 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4c436239-5658-49dc-8ea3-95714f844329 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:45.551774 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4c436239-5658-49dc-8ea3-95714f844329 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:45.584310 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4c436239-5658-49dc-8ea3-95714f844329 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046216 May 10 17:51:45.584891 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 384/758] 10.222.0.60 () {60 vars in 1342 bytes} [Tue May 10 17:51:45 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:51:45.856758 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b7fca65a-805e-46db-9187-31e54d030b62 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:45.858214 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b7fca65a-805e-46db-9187-31e54d030b62 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:45.871074 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b7fca65a-805e-46db-9187-31e54d030b62 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:45.876450 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b7fca65a-805e-46db-9187-31e54d030b62 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:45.877616 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b7fca65a-805e-46db-9187-31e54d030b62 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:45.878063 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b7fca65a-805e-46db-9187-31e54d030b62 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:46.091177 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b7fca65a-805e-46db-9187-31e54d030b62 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:46.096915 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b7fca65a-805e-46db-9187-31e54d030b62 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 200 len: 1367 microversion: 2.1 time: 0.243942 May 10 17:51:46.097486 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 375/759] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:45 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:46.597441 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9d438c1e-a8fa-46c8-8147-eb9db6c4b592 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:46.598410 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-9d438c1e-a8fa-46c8-8147-eb9db6c4b592 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:46.606254 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9d438c1e-a8fa-46c8-8147-eb9db6c4b592 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:46.607006 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9d438c1e-a8fa-46c8-8147-eb9db6c4b592 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:46.607822 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9d438c1e-a8fa-46c8-8147-eb9db6c4b592 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:46.608465 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9d438c1e-a8fa-46c8-8147-eb9db6c4b592 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:46.646831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-9d438c1e-a8fa-46c8-8147-eb9db6c4b592 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053474 May 10 17:51:46.647521 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 385/760] 10.222.0.60 () {60 vars in 1342 bytes} [Tue May 10 17:51:46 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:46.730644 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-01dd33ee-a995-4a29-8ba5-5b904831b6d4 req-9cdade4f-e910-4e9a-b76e-68dbaa936fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed2618f3-4f12-48c9-888c-814f93d1fc49", "tag": "33f2c369-a8b0-48aa-b116-b1391feb5a44"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:51:46.737070 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-bc627d4c-d4fc-43e6-8519-9a565c4f1685 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:46.738057 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-bc627d4c-d4fc-43e6-8519-9a565c4f1685 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:46.749209 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bc627d4c-d4fc-43e6-8519-9a565c4f1685 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:46.749984 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bc627d4c-d4fc-43e6-8519-9a565c4f1685 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:46.751134 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bc627d4c-d4fc-43e6-8519-9a565c4f1685 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:46.751806 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bc627d4c-d4fc-43e6-8519-9a565c4f1685 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:46.757516 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-01dd33ee-a995-4a29-8ba5-5b904831b6d4 req-9cdade4f-e910-4e9a-b76e-68dbaa936fc3 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:46.764515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-01dd33ee-a995-4a29-8ba5-5b904831b6d4 req-9cdade4f-e910-4e9a-b76e-68dbaa936fc3 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:46.788404 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-01dd33ee-a995-4a29-8ba5-5b904831b6d4 req-9cdade4f-e910-4e9a-b76e-68dbaa936fc3 service nova] Creating event network-changed:33f2c369-a8b0-48aa-b116-b1391feb5a44 for instance ed2618f3-4f12-48c9-888c-814f93d1fc49 on hv-cinder-84130 May 10 17:51:46.789938 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-bc627d4c-d4fc-43e6-8519-9a565c4f1685 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Going to try to terminate instance {{(pid=123753) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:51:46.799353 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-01dd33ee-a995-4a29-8ba5-5b904831b6d4 req-9cdade4f-e910-4e9a-b76e-68dbaa936fc3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081664 May 10 17:51:46.800349 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 376/761] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:51:46.891289 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-bc627d4c-d4fc-43e6-8519-9a565c4f1685 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 204 len: 0 microversion: 2.20 time: 0.157162 May 10 17:51:46.892728 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 386/762] 10.222.0.60 () {60 vars in 1279 bytes} [Tue May 10 17:51:46 2022] DELETE /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 17:51:46.906953 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0a736442-8e54-4eb4-9b81-bd4891732566 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:46.908377 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0a736442-8e54-4eb4-9b81-bd4891732566 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:46.916435 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0a736442-8e54-4eb4-9b81-bd4891732566 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:46.916915 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0a736442-8e54-4eb4-9b81-bd4891732566 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:46.918727 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0a736442-8e54-4eb4-9b81-bd4891732566 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:46.919181 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0a736442-8e54-4eb4-9b81-bd4891732566 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:47.059224 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0a736442-8e54-4eb4-9b81-bd4891732566 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:47.067340 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0a736442-8e54-4eb4-9b81-bd4891732566 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:47.068873 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0a736442-8e54-4eb4-9b81-bd4891732566 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:47.070052 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0a736442-8e54-4eb4-9b81-bd4891732566 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.172309 May 10 17:51:47.071339 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 377/763] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:51:46 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:51:47.116532 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-377b25b6-2462-4410-ac9c-075932d23964 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:47.118454 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-377b25b6-2462-4410-ac9c-075932d23964 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:47.124519 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-377b25b6-2462-4410-ac9c-075932d23964 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:47.124975 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-377b25b6-2462-4410-ac9c-075932d23964 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:47.125745 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-377b25b6-2462-4410-ac9c-075932d23964 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:47.126188 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-377b25b6-2462-4410-ac9c-075932d23964 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:47.260964 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-377b25b6-2462-4410-ac9c-075932d23964 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:47.268343 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-377b25b6-2462-4410-ac9c-075932d23964 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 200 len: 1367 microversion: 2.1 time: 0.156376 May 10 17:51:47.268910 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 387/764] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:47 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:48.089699 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-91814d8a-f6af-4cb3-8ee4-e5e0865a371a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:48.090236 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-91814d8a-f6af-4cb3-8ee4-e5e0865a371a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:48.096781 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-91814d8a-f6af-4cb3-8ee4-e5e0865a371a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:48.097229 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-91814d8a-f6af-4cb3-8ee4-e5e0865a371a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:48.098005 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-91814d8a-f6af-4cb3-8ee4-e5e0865a371a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:48.098441 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-91814d8a-f6af-4cb3-8ee4-e5e0865a371a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:48.244442 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-91814d8a-f6af-4cb3-8ee4-e5e0865a371a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:48.253521 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-91814d8a-f6af-4cb3-8ee4-e5e0865a371a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:48.255077 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-91814d8a-f6af-4cb3-8ee4-e5e0865a371a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:48.256306 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-91814d8a-f6af-4cb3-8ee4-e5e0865a371a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.171241 May 10 17:51:48.256867 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 378/765] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:51:48 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:51:48.288550 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fba5ed74-f9ae-4824-a08a-edbcc9481442 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:48.289562 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-fba5ed74-f9ae-4824-a08a-edbcc9481442 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:48.297362 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fba5ed74-f9ae-4824-a08a-edbcc9481442 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:48.297829 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fba5ed74-f9ae-4824-a08a-edbcc9481442 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:48.298657 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fba5ed74-f9ae-4824-a08a-edbcc9481442 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:48.300122 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fba5ed74-f9ae-4824-a08a-edbcc9481442 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:48.547118 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fba5ed74-f9ae-4824-a08a-edbcc9481442 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:48.556986 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-fba5ed74-f9ae-4824-a08a-edbcc9481442 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 200 len: 1367 microversion: 2.1 time: 0.274799 May 10 17:51:48.557623 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 388/766] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:48 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:49.281217 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cc9c6e1d-321c-4b2f-8a89-5486c6cb9218 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:49.281842 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cc9c6e1d-321c-4b2f-8a89-5486c6cb9218 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:49.288658 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cc9c6e1d-321c-4b2f-8a89-5486c6cb9218 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:49.290104 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cc9c6e1d-321c-4b2f-8a89-5486c6cb9218 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:49.290901 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cc9c6e1d-321c-4b2f-8a89-5486c6cb9218 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:49.291345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cc9c6e1d-321c-4b2f-8a89-5486c6cb9218 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:49.426556 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cc9c6e1d-321c-4b2f-8a89-5486c6cb9218 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:49.434526 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cc9c6e1d-321c-4b2f-8a89-5486c6cb9218 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:49.436066 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-cc9c6e1d-321c-4b2f-8a89-5486c6cb9218 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:49.437228 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cc9c6e1d-321c-4b2f-8a89-5486c6cb9218 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.160669 May 10 17:51:49.437787 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 379/767] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:51:49 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:51:49.574915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-99269ea5-8eaf-4a2d-bf6a-8b634fa5b8ca tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:49.575477 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-99269ea5-8eaf-4a2d-bf6a-8b634fa5b8ca tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:49.581851 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-99269ea5-8eaf-4a2d-bf6a-8b634fa5b8ca tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:49.582303 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-99269ea5-8eaf-4a2d-bf6a-8b634fa5b8ca tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:49.583073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-99269ea5-8eaf-4a2d-bf6a-8b634fa5b8ca tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:49.583542 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-99269ea5-8eaf-4a2d-bf6a-8b634fa5b8ca tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:49.715098 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-99269ea5-8eaf-4a2d-bf6a-8b634fa5b8ca tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:49.722383 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-99269ea5-8eaf-4a2d-bf6a-8b634fa5b8ca tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 200 len: 1367 microversion: 2.1 time: 0.152214 May 10 17:51:49.722905 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 389/768] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:49 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:50.456421 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-73e1e4b5-406f-42c4-9cec-fbb589031a41 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:50.457033 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-73e1e4b5-406f-42c4-9cec-fbb589031a41 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:50.463920 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-73e1e4b5-406f-42c4-9cec-fbb589031a41 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:50.464375 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-73e1e4b5-406f-42c4-9cec-fbb589031a41 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:50.465150 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-73e1e4b5-406f-42c4-9cec-fbb589031a41 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:50.465586 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-73e1e4b5-406f-42c4-9cec-fbb589031a41 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:50.597974 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-73e1e4b5-406f-42c4-9cec-fbb589031a41 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:50.605801 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-73e1e4b5-406f-42c4-9cec-fbb589031a41 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:50.607285 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-73e1e4b5-406f-42c4-9cec-fbb589031a41 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:50.608473 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-73e1e4b5-406f-42c4-9cec-fbb589031a41 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.155960 May 10 17:51:50.609022 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 380/769] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:51:50 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:51:50.739051 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-24adf229-830b-4e1b-a943-f80d6a06f55a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:50.739687 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-24adf229-830b-4e1b-a943-f80d6a06f55a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:50.746500 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-24adf229-830b-4e1b-a943-f80d6a06f55a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:50.746946 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-24adf229-830b-4e1b-a943-f80d6a06f55a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:50.747734 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-24adf229-830b-4e1b-a943-f80d6a06f55a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:50.748167 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-24adf229-830b-4e1b-a943-f80d6a06f55a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:50.879905 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-24adf229-830b-4e1b-a943-f80d6a06f55a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:50.887414 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-24adf229-830b-4e1b-a943-f80d6a06f55a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 200 len: 1367 microversion: 2.1 time: 0.152153 May 10 17:51:50.888164 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 390/770] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:50 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:51.628645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7b23f026-52ba-4453-b0a7-dc55e9e5d096 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:51.629501 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7b23f026-52ba-4453-b0a7-dc55e9e5d096 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:51.638466 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b23f026-52ba-4453-b0a7-dc55e9e5d096 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:51.638921 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b23f026-52ba-4453-b0a7-dc55e9e5d096 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:51.639774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b23f026-52ba-4453-b0a7-dc55e9e5d096 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:51.640214 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b23f026-52ba-4453-b0a7-dc55e9e5d096 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:51.873930 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7b23f026-52ba-4453-b0a7-dc55e9e5d096 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:51.881931 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7b23f026-52ba-4453-b0a7-dc55e9e5d096 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:51.884287 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7b23f026-52ba-4453-b0a7-dc55e9e5d096 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:51.885501 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7b23f026-52ba-4453-b0a7-dc55e9e5d096 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1724 microversion: 2.20 time: 0.260960 May 10 17:51:51.886069 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 381/771] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:51:51 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:51:51.905373 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-18ad9244-7192-4699-8539-91edf333528d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:51.905986 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-18ad9244-7192-4699-8539-91edf333528d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:51.912612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-18ad9244-7192-4699-8539-91edf333528d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:51.913063 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-18ad9244-7192-4699-8539-91edf333528d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:51.914078 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-18ad9244-7192-4699-8539-91edf333528d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:51.914485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-18ad9244-7192-4699-8539-91edf333528d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:52.136204 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-18ad9244-7192-4699-8539-91edf333528d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:52.144008 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-18ad9244-7192-4699-8539-91edf333528d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 200 len: 1367 microversion: 2.1 time: 0.242431 May 10 17:51:52.144593 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 391/772] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:51 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:52.594562 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-723a416e-09a1-4e9b-be21-eaa2e63eb136 req-0d925004-6b57-4083-94fe-2a7f1be1f581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4006eed6-2338-46b7-9133-e5c3fdead35c", "name": "network-vif-deleted", "tag": "e697d9cb-ff2b-45a4-8326-f3219cdf4121"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:51:52.607779 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-723a416e-09a1-4e9b-be21-eaa2e63eb136 req-0d925004-6b57-4083-94fe-2a7f1be1f581 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:52.608233 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-723a416e-09a1-4e9b-be21-eaa2e63eb136 req-0d925004-6b57-4083-94fe-2a7f1be1f581 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:52.623445 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-723a416e-09a1-4e9b-be21-eaa2e63eb136 req-0d925004-6b57-4083-94fe-2a7f1be1f581 service nova] Creating event network-vif-deleted:e697d9cb-ff2b-45a4-8326-f3219cdf4121 for instance 4006eed6-2338-46b7-9133-e5c3fdead35c on hv-cinder-84130 May 10 17:51:52.631056 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-723a416e-09a1-4e9b-be21-eaa2e63eb136 req-0d925004-6b57-4083-94fe-2a7f1be1f581 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040158 May 10 17:51:52.632979 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 382/773] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:51:52.903962 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e24f29fa-1726-455e-9a99-60ca54d931a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:52.904459 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e24f29fa-1726-455e-9a99-60ca54d931a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:52.911297 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e24f29fa-1726-455e-9a99-60ca54d931a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:52.912027 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e24f29fa-1726-455e-9a99-60ca54d931a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:52.912520 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e24f29fa-1726-455e-9a99-60ca54d931a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:52.912944 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e24f29fa-1726-455e-9a99-60ca54d931a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:52.943720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e24f29fa-1726-455e-9a99-60ca54d931a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:52.944169 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e24f29fa-1726-455e-9a99-60ca54d931a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:52.944615 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.objects.instance [None req-e24f29fa-1726-455e-9a99-60ca54d931a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lazy-loading 'fault' on Instance uuid 4006eed6-2338-46b7-9133-e5c3fdead35c {{(pid=123753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:51:52.988276 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e24f29fa-1726-455e-9a99-60ca54d931a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:52.996763 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e24f29fa-1726-455e-9a99-60ca54d931a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:52.998266 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e24f29fa-1726-455e-9a99-60ca54d931a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:52.999464 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e24f29fa-1726-455e-9a99-60ca54d931a4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 200 len: 1371 microversion: 2.20 time: 0.099525 May 10 17:51:53.000028 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 392/774] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:51:52 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:51:53.161943 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2043eb07-910c-4f6c-b64b-5afa5a5569ba tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:53.163082 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2043eb07-910c-4f6c-b64b-5afa5a5569ba tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:53.182902 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2043eb07-910c-4f6c-b64b-5afa5a5569ba tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:53.183461 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2043eb07-910c-4f6c-b64b-5afa5a5569ba tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:53.184169 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2043eb07-910c-4f6c-b64b-5afa5a5569ba tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:53.184612 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2043eb07-910c-4f6c-b64b-5afa5a5569ba tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:53.320898 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2043eb07-910c-4f6c-b64b-5afa5a5569ba tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:53.329995 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2043eb07-910c-4f6c-b64b-5afa5a5569ba tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 200 len: 1367 microversion: 2.1 time: 0.172285 May 10 17:51:53.330624 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 383/775] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:53 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:51:54.018322 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7c8ced29-5c9b-43fa-b345-9019d14e56cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:54.018918 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7c8ced29-5c9b-43fa-b345-9019d14e56cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:54.027114 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7c8ced29-5c9b-43fa-b345-9019d14e56cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:54.027591 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7c8ced29-5c9b-43fa-b345-9019d14e56cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:54.028370 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7c8ced29-5c9b-43fa-b345-9019d14e56cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:54.028805 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7c8ced29-5c9b-43fa-b345-9019d14e56cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:54.042568 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-7c8ced29-5c9b-43fa-b345-9019d14e56cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] HTTP exception thrown: Instance 4006eed6-2338-46b7-9133-e5c3fdead35c could not be found. May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7c8ced29-5c9b-43fa-b345-9019d14e56cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Request method failure captured: May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c HTTP/1.1 May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqSMD5zFR04x6JtjS3MbQUgk0VxFiC3AxAUwRqENdzti4WIBX6ZnMRlb9ahyqq6CXfmlXyunZRn50Sb3_IfgcUypC6NDEkZymbOczMSJO2_nFPa_MFyGFjrTS7PVQLqFgKYAlK1sQJBejX-hEE8hAdGyrLzNihPIdGkmPQwbDx3aW5Y May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Openstack-Nova-Api-Version: 2.20 May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: 0461acfadf8743fdbd62a39bf3fe3e1c May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-929324698 May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:51:54.044275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:51:54.045943 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0461acfadf8743fdbd62a39bf3fe3e1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0461acfadf8743fdbd62a39bf3fe3e1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0461acfadf8743fdbd62a39bf3fe3e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0461acfadf8743fdbd62a39bf3fe3e1c"}]}] May 10 17:51:54.045943 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-AttachVolumeShelveTestJSON-929324698 May 10 17:51:54.045943 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: 0461acfadf8743fdbd62a39bf3fe3e1c May 10 17:51:54.045943 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-929324698 May 10 17:51:54.045943 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-AttachVolumeShelveTestJSON-929324698-project May 10 17:51:54.045943 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:51:54.045943 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:51:54.045943 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: ed37128b78a6454c9c387ad91995a05d May 10 17:51:54.045943 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-AttachVolumeShelveTestJSON-929324698-project May 10 17:51:54.045943 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:51:54.045943 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance 4006eed6-2338-46b7-9133-e5c3fdead35c could not be found. May 10 17:51:54.045943 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': '4006eed6-2338-46b7-9133-e5c3fdead35c'} May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4006eed6-2338-46b7-9133-e5c3fdead35c could not be found. May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:51:54.047023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:51:54.048480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:51:54.048480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:51:54.048480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:51:54.048480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:51:54.048480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:51:54.048480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:51:54.048480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:51:54.048480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4006eed6-2338-46b7-9133-e5c3fdead35c could not be found. May 10 17:51:54.048480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:51:54.048480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:51:54.048480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:51:54.048480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:51:54.048480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:51:54.048480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:51:54.048480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:51:54.048480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:51:54.048480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4006eed6-2338-46b7-9133-e5c3fdead35c could not be found. May 10 17:51:54.048480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:51:54.049853 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7c8ced29-5c9b-43fa-b345-9019d14e56cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Returning 404 to user: Instance 4006eed6-2338-46b7-9133-e5c3fdead35c could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:51:54.049853 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7c8ced29-5c9b-43fa-b345-9019d14e56cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 404 len: 111 microversion: 2.20 time: 0.031369 May 10 17:51:54.049853 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 393/776] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:51:54 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 17:51:54.054676 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c8d0ad63-78ea-460a-b43c-0d485aa3e558 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '.version_select at 0x7f3e7baf6670>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:54.075831 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c8d0ad63-78ea-460a-b43c-0d485aa3e558 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1037564527" status: 204 len: 0 microversion: 2.20 time: 0.024904 May 10 17:51:54.076443 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 384/777] 10.222.0.60 () {60 vars in 1261 bytes} [Tue May 10 17:51:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1037564527 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 17:51:54.347929 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2fd83d91-abd3-48bb-8f7a-c3595b8507df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:54.348458 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-2fd83d91-abd3-48bb-8f7a-c3595b8507df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:54.356163 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2fd83d91-abd3-48bb-8f7a-c3595b8507df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:54.356163 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2fd83d91-abd3-48bb-8f7a-c3595b8507df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:54.356163 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2fd83d91-abd3-48bb-8f7a-c3595b8507df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:54.356548 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2fd83d91-abd3-48bb-8f7a-c3595b8507df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:54.498058 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-2fd83d91-abd3-48bb-8f7a-c3595b8507df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:54.505556 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-2fd83d91-abd3-48bb-8f7a-c3595b8507df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 200 len: 1367 microversion: 2.1 time: 0.161509 May 10 17:51:54.506139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 394/778] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:54 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:54.720710 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c832f77e-7272-4581-beac-9d36f188fb55 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Action: 'create', calling method: .version_select at 0x7f3e766fcc10>, body: {"keypair": {"name": "tempest-keypair-1019081118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSMz1ajuHBW8MJj9+JdYJkZrzcF+zXjsOwIF/7l8wRfl6V0TOceai6Bn/y/C9XU316PuaTWQlejFlE8utgMrk9x5TLDRS6D9zl1jI5TvZmfUznI1Z9LJe3dbdMJ70i63Q=="}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:51:54.740214 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-c832f77e-7272-4581-beac-9d36f188fb55 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Getting quotas for project 0461acfadf8743fdbd62a39bf3fe3e1c. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:51:54.744997 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-c832f77e-7272-4581-beac-9d36f188fb55 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Getting quotas for user ed37128b78a6454c9c387ad91995a05d and project 0461acfadf8743fdbd62a39bf3fe3e1c. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:51:54.767695 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c832f77e-7272-4581-beac-9d36f188fb55 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.051811 May 10 17:51:54.768278 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 385/779] 10.222.0.60 () {62 vars in 1199 bytes} [Tue May 10 17:51:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 10 17:51:54.975685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-45275adb-4327-406d-8cb0-fc615284e687 req-2c7bc38e-1e9c-4b90-84c1-a625b2577a88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2618f3-4f12-48c9-888c-814f93d1fc49", "name": "network-vif-plugged", "status": "completed", "tag": "33f2c369-a8b0-48aa-b116-b1391feb5a44"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:51:54.987842 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-45275adb-4327-406d-8cb0-fc615284e687 req-2c7bc38e-1e9c-4b90-84c1-a625b2577a88 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:54.988396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-45275adb-4327-406d-8cb0-fc615284e687 req-2c7bc38e-1e9c-4b90-84c1-a625b2577a88 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:55.005894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-45275adb-4327-406d-8cb0-fc615284e687 req-2c7bc38e-1e9c-4b90-84c1-a625b2577a88 service nova] Creating event network-vif-plugged:33f2c369-a8b0-48aa-b116-b1391feb5a44 for instance ed2618f3-4f12-48c9-888c-814f93d1fc49 on hv-cinder-84130 May 10 17:51:55.011549 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-45275adb-4327-406d-8cb0-fc615284e687 req-2c7bc38e-1e9c-4b90-84c1-a625b2577a88 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039943 May 10 17:51:55.012312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 395/780] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:51:55.523959 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2e1c167c-93ac-4c23-acc5-4d5cc0eec543 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:55.524974 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2e1c167c-93ac-4c23-acc5-4d5cc0eec543 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:55.532006 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e1c167c-93ac-4c23-acc5-4d5cc0eec543 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:55.532551 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e1c167c-93ac-4c23-acc5-4d5cc0eec543 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:55.533347 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e1c167c-93ac-4c23-acc5-4d5cc0eec543 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:55.533804 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2e1c167c-93ac-4c23-acc5-4d5cc0eec543 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:55.727645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2e1c167c-93ac-4c23-acc5-4d5cc0eec543 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:55.736377 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2e1c167c-93ac-4c23-acc5-4d5cc0eec543 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 200 len: 1367 microversion: 2.1 time: 0.217146 May 10 17:51:55.736969 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 386/781] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:55 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:56.279864 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-d1ac94d4-c50e-496f-b48b-078ba420e1d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-692027782", "imageRef": "a7737c62-8029-44aa-8da7-e46fea7607fb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4f6007aa-61b1-40c3-a8ad-7f431d419cb5"}], "security_groups": [{"name": "tempest-securitygroup--618401566"}], "key_name": "tempest-keypair-1019081118", "user_data": "}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:51:56.384578 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.network.neutron [None req-d1ac94d4-c50e-496f-b48b-078ba420e1d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] validate_networks() for [('4f6007aa-61b1-40c3-a8ad-7f431d419cb5', None, None, None, None, None)] {{(pid=123753) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:51:56.755239 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-84893953-f2c2-4ec2-9f9e-3bd5837e2196 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:56.755835 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-84893953-f2c2-4ec2-9f9e-3bd5837e2196 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:56.763637 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-84893953-f2c2-4ec2-9f9e-3bd5837e2196 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:56.764109 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-84893953-f2c2-4ec2-9f9e-3bd5837e2196 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:56.764913 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-84893953-f2c2-4ec2-9f9e-3bd5837e2196 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:56.765358 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-84893953-f2c2-4ec2-9f9e-3bd5837e2196 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:56.768213 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-d1ac94d4-c50e-496f-b48b-078ba420e1d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Flavor limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:51:56.768638 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-d1ac94d4-c50e-496f-b48b-078ba420e1d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Image limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:51:56.769113 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-d1ac94d4-c50e-496f-b48b-078ba420e1d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Flavor pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:51:56.770870 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-d1ac94d4-c50e-496f-b48b-078ba420e1d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Image pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:51:56.770870 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-d1ac94d4-c50e-496f-b48b-078ba420e1d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:51:56.778588 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d1ac94d4-c50e-496f-b48b-078ba420e1d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:56.779037 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d1ac94d4-c50e-496f-b48b-078ba420e1d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:56.779870 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d1ac94d4-c50e-496f-b48b-078ba420e1d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:56.780318 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d1ac94d4-c50e-496f-b48b-078ba420e1d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:56.797276 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-d1ac94d4-c50e-496f-b48b-078ba420e1d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Getting quotas for project 0461acfadf8743fdbd62a39bf3fe3e1c. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:51:56.801382 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-d1ac94d4-c50e-496f-b48b-078ba420e1d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Getting quotas for user ed37128b78a6454c9c387ad91995a05d and project 0461acfadf8743fdbd62a39bf3fe3e1c. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:51:56.813817 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-d1ac94d4-c50e-496f-b48b-078ba420e1d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Going to run 1 instances... {{(pid=123753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:51:56.816235 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-d1ac94d4-c50e-496f-b48b-078ba420e1d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7737c62-8029-44aa-8da7-e46fea7607fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:51:56.869645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-d1ac94d4-c50e-496f-b48b-078ba420e1d3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.594828 May 10 17:51:56.870546 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 396/782] 10.222.0.60 () {62 vars in 1187 bytes} [Tue May 10 17:51:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 10 17:51:56.880774 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-65574c54-ec88-43f0-b04d-451a989bc41d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:56.881397 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-65574c54-ec88-43f0-b04d-451a989bc41d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:56.930111 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-84893953-f2c2-4ec2-9f9e-3bd5837e2196 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:56.938122 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-84893953-f2c2-4ec2-9f9e-3bd5837e2196 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 200 len: 1367 microversion: 2.1 time: 0.187067 May 10 17:51:56.938519 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 387/783] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:56 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:51:56.953088 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-65574c54-ec88-43f0-b04d-451a989bc41d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:56.962228 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-65574c54-ec88-43f0-b04d-451a989bc41d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:56.964197 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-65574c54-ec88-43f0-b04d-451a989bc41d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:56.965807 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-65574c54-ec88-43f0-b04d-451a989bc41d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1281 microversion: 2.20 time: 0.089028 May 10 17:51:56.967476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 397/784] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:51:56 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1281 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:51:57.956038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b50043a8-a363-43ca-8ad9-cc2319edb4df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:57.956685 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b50043a8-a363-43ca-8ad9-cc2319edb4df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:57.964124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b50043a8-a363-43ca-8ad9-cc2319edb4df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:57.964586 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b50043a8-a363-43ca-8ad9-cc2319edb4df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:57.965383 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b50043a8-a363-43ca-8ad9-cc2319edb4df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:57.965828 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b50043a8-a363-43ca-8ad9-cc2319edb4df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:57.983811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f0d38fe3-bfd7-489f-a577-2b2b95bbd52c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:57.984679 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f0d38fe3-bfd7-489f-a577-2b2b95bbd52c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:57.992672 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f0d38fe3-bfd7-489f-a577-2b2b95bbd52c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:57.993127 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f0d38fe3-bfd7-489f-a577-2b2b95bbd52c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:57.993902 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f0d38fe3-bfd7-489f-a577-2b2b95bbd52c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:57.994340 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f0d38fe3-bfd7-489f-a577-2b2b95bbd52c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:58.067300 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f0d38fe3-bfd7-489f-a577-2b2b95bbd52c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:58.076942 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f0d38fe3-bfd7-489f-a577-2b2b95bbd52c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:58.078498 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f0d38fe3-bfd7-489f-a577-2b2b95bbd52c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:58.079657 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f0d38fe3-bfd7-489f-a577-2b2b95bbd52c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1333 microversion: 2.20 time: 0.099756 May 10 17:51:58.080204 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 398/785] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:51:57 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1333 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:51:58.125701 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b50043a8-a363-43ca-8ad9-cc2319edb4df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:58.134022 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b50043a8-a363-43ca-8ad9-cc2319edb4df tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 200 len: 1557 microversion: 2.1 time: 0.181819 May 10 17:51:58.134666 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 388/786] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:51:57 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 1557 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:51:58.152010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7690d47f-c5ee-4c97-93c7-f25f4eb90dbf tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:58.152533 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7690d47f-c5ee-4c97-93c7-f25f4eb90dbf tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:58.158793 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7690d47f-c5ee-4c97-93c7-f25f4eb90dbf tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:58.159240 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7690d47f-c5ee-4c97-93c7-f25f4eb90dbf tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:58.160338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7690d47f-c5ee-4c97-93c7-f25f4eb90dbf tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:58.160777 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7690d47f-c5ee-4c97-93c7-f25f4eb90dbf tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:58.293808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7690d47f-c5ee-4c97-93c7-f25f4eb90dbf tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.147268 May 10 17:51:58.300944 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 399/787] 10.222.0.60 () {58 vars in 1274 bytes} [Tue May 10 17:51:58 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49/os-interface => generated 284 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:51:59.098268 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-abbb463c-7057-4294-b447-ac4897e54118 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:51:59.099856 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-abbb463c-7057-4294-b447-ac4897e54118 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:51:59.110080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-abbb463c-7057-4294-b447-ac4897e54118 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:59.110641 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-abbb463c-7057-4294-b447-ac4897e54118 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:59.111595 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-abbb463c-7057-4294-b447-ac4897e54118 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:59.112115 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-abbb463c-7057-4294-b447-ac4897e54118 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:59.187673 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-abbb463c-7057-4294-b447-ac4897e54118 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:59.196884 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-abbb463c-7057-4294-b447-ac4897e54118 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:59.198802 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-abbb463c-7057-4294-b447-ac4897e54118 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:51:59.200069 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-abbb463c-7057-4294-b447-ac4897e54118 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1339 microversion: 2.20 time: 0.106052 May 10 17:51:59.200898 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 389/788] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:51:59 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1339 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:51:59.697850 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-f439bca1-6955-4aae-a231-06c789e3a0ba req-5fc8ca7a-0d3c-4868-a440-5082d8dcdf9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed2618f3-4f12-48c9-888c-814f93d1fc49", "tag": "33f2c369-a8b0-48aa-b116-b1391feb5a44"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:51:59.709524 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-f439bca1-6955-4aae-a231-06c789e3a0ba req-5fc8ca7a-0d3c-4868-a440-5082d8dcdf9d service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:51:59.710513 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-f439bca1-6955-4aae-a231-06c789e3a0ba req-5fc8ca7a-0d3c-4868-a440-5082d8dcdf9d service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:51:59.724729 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-f439bca1-6955-4aae-a231-06c789e3a0ba req-5fc8ca7a-0d3c-4868-a440-5082d8dcdf9d service nova] Creating event network-changed:33f2c369-a8b0-48aa-b116-b1391feb5a44 for instance ed2618f3-4f12-48c9-888c-814f93d1fc49 on hv-cinder-84130 May 10 17:51:59.730585 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-f439bca1-6955-4aae-a231-06c789e3a0ba req-5fc8ca7a-0d3c-4868-a440-5082d8dcdf9d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133107 May 10 17:51:59.735606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 400/789] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:52:00.218860 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-ce3b346b-cad4-440b-98e9-2233d0de190b req-de907cbb-a034-4a78-a885-05a5cd60e675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e16b7603-15a8-44a4-82c9-729bedfb8ac6", "tag": "cb176284-f148-403c-b988-83b0bfbdd7dd"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:52:00.225689 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-0a431707-b995-4ed2-9a87-7783c83b5a8c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:00.227348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-0a431707-b995-4ed2-9a87-7783c83b5a8c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:00.242276 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-ce3b346b-cad4-440b-98e9-2233d0de190b req-de907cbb-a034-4a78-a885-05a5cd60e675 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:00.263630 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0a431707-b995-4ed2-9a87-7783c83b5a8c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:00.264700 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-ce3b346b-cad4-440b-98e9-2233d0de190b req-de907cbb-a034-4a78-a885-05a5cd60e675 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:00.265931 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0a431707-b995-4ed2-9a87-7783c83b5a8c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:00.269977 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0a431707-b995-4ed2-9a87-7783c83b5a8c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:00.270710 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0a431707-b995-4ed2-9a87-7783c83b5a8c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:00.293202 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-ce3b346b-cad4-440b-98e9-2233d0de190b req-de907cbb-a034-4a78-a885-05a5cd60e675 service nova] Creating event network-changed:cb176284-f148-403c-b988-83b0bfbdd7dd for instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 on hv-cinder-84130 May 10 17:52:00.301618 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-ce3b346b-cad4-440b-98e9-2233d0de190b req-de907cbb-a034-4a78-a885-05a5cd60e675 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086490 May 10 17:52:00.303959 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 390/790] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:52:00.568620 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-0a431707-b995-4ed2-9a87-7783c83b5a8c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:00.581432 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-0a431707-b995-4ed2-9a87-7783c83b5a8c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:00.586077 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-0a431707-b995-4ed2-9a87-7783c83b5a8c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:00.587497 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-0a431707-b995-4ed2-9a87-7783c83b5a8c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1406 microversion: 2.20 time: 0.366863 May 10 17:52:00.588753 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 401/791] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:52:00 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1406 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:52:01.607430 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-15898d1a-5888-495c-8e49-94fda9765cab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:01.608188 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-15898d1a-5888-495c-8e49-94fda9765cab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:01.614488 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-15898d1a-5888-495c-8e49-94fda9765cab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:01.614945 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-15898d1a-5888-495c-8e49-94fda9765cab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:01.615761 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-15898d1a-5888-495c-8e49-94fda9765cab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:01.616199 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-15898d1a-5888-495c-8e49-94fda9765cab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:01.759981 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-15898d1a-5888-495c-8e49-94fda9765cab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:01.770848 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-15898d1a-5888-495c-8e49-94fda9765cab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:01.773253 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-15898d1a-5888-495c-8e49-94fda9765cab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:01.775355 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-15898d1a-5888-495c-8e49-94fda9765cab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1406 microversion: 2.20 time: 0.172611 May 10 17:52:01.776424 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 391/792] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:52:01 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:52:02.797565 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-d3c1c124-bd5e-49f9-94f4-eda2dbcc406b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:02.798198 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-d3c1c124-bd5e-49f9-94f4-eda2dbcc406b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:02.805887 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d3c1c124-bd5e-49f9-94f4-eda2dbcc406b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:02.806407 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d3c1c124-bd5e-49f9-94f4-eda2dbcc406b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:02.807617 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d3c1c124-bd5e-49f9-94f4-eda2dbcc406b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:02.808396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d3c1c124-bd5e-49f9-94f4-eda2dbcc406b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:02.948465 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-d3c1c124-bd5e-49f9-94f4-eda2dbcc406b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:02.956467 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-d3c1c124-bd5e-49f9-94f4-eda2dbcc406b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:02.957965 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-d3c1c124-bd5e-49f9-94f4-eda2dbcc406b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:02.959084 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-d3c1c124-bd5e-49f9-94f4-eda2dbcc406b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1406 microversion: 2.20 time: 0.165949 May 10 17:52:02.959674 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 402/793] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:52:02 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:52:03.978431 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0bdb878e-1b98-4d44-bce7-ea158f66fe94 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:03.979267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0bdb878e-1b98-4d44-bce7-ea158f66fe94 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:03.985937 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0bdb878e-1b98-4d44-bce7-ea158f66fe94 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:03.986389 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0bdb878e-1b98-4d44-bce7-ea158f66fe94 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:03.987166 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0bdb878e-1b98-4d44-bce7-ea158f66fe94 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:03.987631 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0bdb878e-1b98-4d44-bce7-ea158f66fe94 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:04.124143 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0bdb878e-1b98-4d44-bce7-ea158f66fe94 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:04.133797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0bdb878e-1b98-4d44-bce7-ea158f66fe94 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:04.135386 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0bdb878e-1b98-4d44-bce7-ea158f66fe94 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:04.136601 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0bdb878e-1b98-4d44-bce7-ea158f66fe94 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1406 microversion: 2.20 time: 0.163130 May 10 17:52:04.137344 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 392/794] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:52:03 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:52:05.155126 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-74df62e0-0543-4114-9b77-348568e94926 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:05.155808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-74df62e0-0543-4114-9b77-348568e94926 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:05.162207 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-74df62e0-0543-4114-9b77-348568e94926 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:05.162653 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-74df62e0-0543-4114-9b77-348568e94926 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:05.163603 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-74df62e0-0543-4114-9b77-348568e94926 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:05.164196 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-74df62e0-0543-4114-9b77-348568e94926 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:05.296455 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-74df62e0-0543-4114-9b77-348568e94926 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:05.304297 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-74df62e0-0543-4114-9b77-348568e94926 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:05.305792 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-74df62e0-0543-4114-9b77-348568e94926 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:05.306881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-74df62e0-0543-4114-9b77-348568e94926 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1406 microversion: 2.20 time: 0.155666 May 10 17:52:05.307460 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 403/795] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:52:05 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:52:05.872988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7ec3351b-4300-4fe7-95e8-2f41174cc0cf tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:05.873533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7ec3351b-4300-4fe7-95e8-2f41174cc0cf tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:05.879885 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7ec3351b-4300-4fe7-95e8-2f41174cc0cf tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:05.880333 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7ec3351b-4300-4fe7-95e8-2f41174cc0cf tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:05.881102 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7ec3351b-4300-4fe7-95e8-2f41174cc0cf tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:05.881573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7ec3351b-4300-4fe7-95e8-2f41174cc0cf tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:05.966279 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-7ec3351b-4300-4fe7-95e8-2f41174cc0cf tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lazy-loading 'services' on Instance uuid e4553a66-9c17-4820-a5ab-1e3f45b42cb2 {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:52:06.042603 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7ec3351b-4300-4fe7-95e8-2f41174cc0cf tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/os-volume_attachments/0b79c0d6-1bab-4c94-8a2a-72d5d9e77fb4" status: 202 len: 0 microversion: 2.1 time: 0.173188 May 10 17:52:06.043197 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 393/796] 10.222.0.60 () {58 vars in 1415 bytes} [Tue May 10 17:52:05 2022] DELETE /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/os-volume_attachments/0b79c0d6-1bab-4c94-8a2a-72d5d9e77fb4 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:52:06.052591 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-54d4690f-3a9e-4885-8d63-88f61e1f7419 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:06.053583 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-54d4690f-3a9e-4885-8d63-88f61e1f7419 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:06.059841 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-54d4690f-3a9e-4885-8d63-88f61e1f7419 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:06.060293 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-54d4690f-3a9e-4885-8d63-88f61e1f7419 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:06.061403 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-54d4690f-3a9e-4885-8d63-88f61e1f7419 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:06.061868 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-54d4690f-3a9e-4885-8d63-88f61e1f7419 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:06.097091 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-54d4690f-3a9e-4885-8d63-88f61e1f7419 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049237 May 10 17:52:06.097680 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 404/797] 10.222.0.60 () {58 vars in 1301 bytes} [Tue May 10 17:52:06 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:52:06.326226 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1e127184-0e42-4d8a-ab75-2ec3f3ac225d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:06.326907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1e127184-0e42-4d8a-ab75-2ec3f3ac225d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:06.333284 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1e127184-0e42-4d8a-ab75-2ec3f3ac225d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:06.333731 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1e127184-0e42-4d8a-ab75-2ec3f3ac225d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:06.334514 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1e127184-0e42-4d8a-ab75-2ec3f3ac225d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:06.334955 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1e127184-0e42-4d8a-ab75-2ec3f3ac225d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:06.468568 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1e127184-0e42-4d8a-ab75-2ec3f3ac225d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:06.476840 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1e127184-0e42-4d8a-ab75-2ec3f3ac225d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:06.478343 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1e127184-0e42-4d8a-ab75-2ec3f3ac225d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:06.479534 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1e127184-0e42-4d8a-ab75-2ec3f3ac225d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1406 microversion: 2.20 time: 0.157824 May 10 17:52:06.480099 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 394/798] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:52:06 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:52:07.077481 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-b50e3306-d972-4c10-8a08-b152897f45cf req-03348d4f-85b3-42dd-9a34-dca0bc2001f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e16b7603-15a8-44a4-82c9-729bedfb8ac6", "name": "network-vif-plugged", "status": "completed", "tag": "cb176284-f148-403c-b988-83b0bfbdd7dd"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:52:07.086741 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-b50e3306-d972-4c10-8a08-b152897f45cf req-03348d4f-85b3-42dd-9a34-dca0bc2001f7 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:07.087193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-b50e3306-d972-4c10-8a08-b152897f45cf req-03348d4f-85b3-42dd-9a34-dca0bc2001f7 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:07.099298 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-b50e3306-d972-4c10-8a08-b152897f45cf req-03348d4f-85b3-42dd-9a34-dca0bc2001f7 service nova] Creating event network-vif-plugged:cb176284-f148-403c-b988-83b0bfbdd7dd for instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 on hv-cinder-84130 May 10 17:52:07.105897 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-b50e3306-d972-4c10-8a08-b152897f45cf req-03348d4f-85b3-42dd-9a34-dca0bc2001f7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032108 May 10 17:52:07.106803 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 405/799] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:52:07.110413 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c8384ae0-d117-4a13-a740-fc89fb519e6c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:07.111551 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c8384ae0-d117-4a13-a740-fc89fb519e6c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:07.118495 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c8384ae0-d117-4a13-a740-fc89fb519e6c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:07.119021 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c8384ae0-d117-4a13-a740-fc89fb519e6c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:07.119940 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c8384ae0-d117-4a13-a740-fc89fb519e6c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:07.120456 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c8384ae0-d117-4a13-a740-fc89fb519e6c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:07.156350 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c8384ae0-d117-4a13-a740-fc89fb519e6c tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046579 May 10 17:52:07.156350 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 395/800] 10.222.0.60 () {58 vars in 1301 bytes} [Tue May 10 17:52:07 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:52:07.499187 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fecd6047-1a0b-4183-8990-59e0843d9120 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:07.499951 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-fecd6047-1a0b-4183-8990-59e0843d9120 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:07.506262 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fecd6047-1a0b-4183-8990-59e0843d9120 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:07.506717 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fecd6047-1a0b-4183-8990-59e0843d9120 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:07.508131 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fecd6047-1a0b-4183-8990-59e0843d9120 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:07.508585 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fecd6047-1a0b-4183-8990-59e0843d9120 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:07.641359 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fecd6047-1a0b-4183-8990-59e0843d9120 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:07.649663 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fecd6047-1a0b-4183-8990-59e0843d9120 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:07.651157 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fecd6047-1a0b-4183-8990-59e0843d9120 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:07.652439 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-fecd6047-1a0b-4183-8990-59e0843d9120 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1406 microversion: 2.20 time: 0.157645 May 10 17:52:07.653010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 406/801] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:52:07 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:52:08.164894 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-492b2629-f5f1-42e4-89ea-799acd85e1e0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:08.165852 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-492b2629-f5f1-42e4-89ea-799acd85e1e0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:08.172264 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-492b2629-f5f1-42e4-89ea-799acd85e1e0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:08.172718 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-492b2629-f5f1-42e4-89ea-799acd85e1e0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:08.173497 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-492b2629-f5f1-42e4-89ea-799acd85e1e0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:08.173937 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-492b2629-f5f1-42e4-89ea-799acd85e1e0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:08.204688 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-492b2629-f5f1-42e4-89ea-799acd85e1e0 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043830 May 10 17:52:08.205274 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 396/802] 10.222.0.60 () {58 vars in 1301 bytes} [Tue May 10 17:52:08 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 10 17:52:08.285769 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f1242cf9-912f-440f-9a4a-e2ca4d285c30 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:08.286406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f1242cf9-912f-440f-9a4a-e2ca4d285c30 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:08.292886 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f1242cf9-912f-440f-9a4a-e2ca4d285c30 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:08.293343 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f1242cf9-912f-440f-9a4a-e2ca4d285c30 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:08.294131 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f1242cf9-912f-440f-9a4a-e2ca4d285c30 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:08.294579 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f1242cf9-912f-440f-9a4a-e2ca4d285c30 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:08.321284 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f1242cf9-912f-440f-9a4a-e2ca4d285c30 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Going to try to terminate instance {{(pid=123753) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:52:08.408636 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f1242cf9-912f-440f-9a4a-e2ca4d285c30 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 204 len: 0 microversion: 2.1 time: 0.126471 May 10 17:52:08.409234 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 407/803] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:52:08 2022] DELETE /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:52:08.418309 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b6a82a5e-191f-45e3-844e-de02de85ade9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:08.418939 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b6a82a5e-191f-45e3-844e-de02de85ade9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:08.425224 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b6a82a5e-191f-45e3-844e-de02de85ade9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:08.425673 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b6a82a5e-191f-45e3-844e-de02de85ade9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:08.426450 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b6a82a5e-191f-45e3-844e-de02de85ade9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:08.426887 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b6a82a5e-191f-45e3-844e-de02de85ade9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:08.566693 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b6a82a5e-191f-45e3-844e-de02de85ade9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:08.575714 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b6a82a5e-191f-45e3-844e-de02de85ade9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1689 microversion: 2.1 time: 0.161727 May 10 17:52:08.576295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 397/804] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:08 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:08.672685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c001a4b7-8426-4bf7-bd24-bfdb1ca025c3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:08.673488 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c001a4b7-8426-4bf7-bd24-bfdb1ca025c3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:08.681388 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c001a4b7-8426-4bf7-bd24-bfdb1ca025c3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:08.681915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c001a4b7-8426-4bf7-bd24-bfdb1ca025c3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:08.682754 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c001a4b7-8426-4bf7-bd24-bfdb1ca025c3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:08.683309 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c001a4b7-8426-4bf7-bd24-bfdb1ca025c3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:08.828003 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c001a4b7-8426-4bf7-bd24-bfdb1ca025c3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:08.837425 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c001a4b7-8426-4bf7-bd24-bfdb1ca025c3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:08.838939 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c001a4b7-8426-4bf7-bd24-bfdb1ca025c3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:08.840117 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c001a4b7-8426-4bf7-bd24-bfdb1ca025c3 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1406 microversion: 2.20 time: 0.172945 May 10 17:52:08.840685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 408/805] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:52:08 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:52:09.592891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0cb27839-a5ae-4c44-8cdd-3fdf8cd9a7bc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:09.593505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0cb27839-a5ae-4c44-8cdd-3fdf8cd9a7bc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:09.600234 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cb27839-a5ae-4c44-8cdd-3fdf8cd9a7bc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:09.600727 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cb27839-a5ae-4c44-8cdd-3fdf8cd9a7bc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:09.602124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cb27839-a5ae-4c44-8cdd-3fdf8cd9a7bc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:09.602575 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0cb27839-a5ae-4c44-8cdd-3fdf8cd9a7bc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:09.744942 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0cb27839-a5ae-4c44-8cdd-3fdf8cd9a7bc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:09.752876 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0cb27839-a5ae-4c44-8cdd-3fdf8cd9a7bc tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1689 microversion: 2.1 time: 0.163905 May 10 17:52:09.753467 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 398/806] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:09 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:52:09.857887 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e0fe2094-d644-43a4-9503-a45efb742ace tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:09.858436 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e0fe2094-d644-43a4-9503-a45efb742ace tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:09.865048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e0fe2094-d644-43a4-9503-a45efb742ace tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:09.865498 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e0fe2094-d644-43a4-9503-a45efb742ace tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:09.866324 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e0fe2094-d644-43a4-9503-a45efb742ace tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:09.866810 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e0fe2094-d644-43a4-9503-a45efb742ace tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:10.004065 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e0fe2094-d644-43a4-9503-a45efb742ace tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:10.012422 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e0fe2094-d644-43a4-9503-a45efb742ace tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:10.013927 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e0fe2094-d644-43a4-9503-a45efb742ace tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:10.015047 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e0fe2094-d644-43a4-9503-a45efb742ace tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1406 microversion: 2.20 time: 0.161227 May 10 17:52:10.015658 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 409/807] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:52:09 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:52:10.770572 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-82cd6787-0e7f-4074-b4ca-9b7d691f16c9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:10.771163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-82cd6787-0e7f-4074-b4ca-9b7d691f16c9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:10.777785 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-82cd6787-0e7f-4074-b4ca-9b7d691f16c9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:10.778235 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-82cd6787-0e7f-4074-b4ca-9b7d691f16c9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:10.779015 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-82cd6787-0e7f-4074-b4ca-9b7d691f16c9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:10.779482 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-82cd6787-0e7f-4074-b4ca-9b7d691f16c9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:10.916119 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-82cd6787-0e7f-4074-b4ca-9b7d691f16c9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:10.923775 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-82cd6787-0e7f-4074-b4ca-9b7d691f16c9 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1689 microversion: 2.1 time: 0.157037 May 10 17:52:10.924354 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 399/808] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:10 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:11.033671 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-525fe745-5cea-40c5-af18-4c98d118a229 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:11.034228 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-525fe745-5cea-40c5-af18-4c98d118a229 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:11.041048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-525fe745-5cea-40c5-af18-4c98d118a229 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:11.041490 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-525fe745-5cea-40c5-af18-4c98d118a229 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:11.042268 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-525fe745-5cea-40c5-af18-4c98d118a229 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:11.042703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-525fe745-5cea-40c5-af18-4c98d118a229 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:11.196579 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-525fe745-5cea-40c5-af18-4c98d118a229 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:11.205449 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-525fe745-5cea-40c5-af18-4c98d118a229 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:11.207029 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-525fe745-5cea-40c5-af18-4c98d118a229 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:11.208188 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-525fe745-5cea-40c5-af18-4c98d118a229 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1406 microversion: 2.20 time: 0.178628 May 10 17:52:11.208762 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 410/809] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:52:11 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:52:11.941851 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-97bea12e-c496-41ab-9fa3-b0e3e988ce35 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:11.942453 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-97bea12e-c496-41ab-9fa3-b0e3e988ce35 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:11.949181 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-97bea12e-c496-41ab-9fa3-b0e3e988ce35 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:11.949645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-97bea12e-c496-41ab-9fa3-b0e3e988ce35 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:11.950423 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-97bea12e-c496-41ab-9fa3-b0e3e988ce35 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:11.951058 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-97bea12e-c496-41ab-9fa3-b0e3e988ce35 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:12.079324 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-97bea12e-c496-41ab-9fa3-b0e3e988ce35 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:12.086646 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-97bea12e-c496-41ab-9fa3-b0e3e988ce35 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1689 microversion: 2.1 time: 0.148724 May 10 17:52:12.087207 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 400/810] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:11 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:12.227318 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-0d57029f-5c01-49cb-b4b2-ffa00210d8c6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:12.228068 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-0d57029f-5c01-49cb-b4b2-ffa00210d8c6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:12.234526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0d57029f-5c01-49cb-b4b2-ffa00210d8c6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:12.234974 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0d57029f-5c01-49cb-b4b2-ffa00210d8c6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:12.235777 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0d57029f-5c01-49cb-b4b2-ffa00210d8c6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:12.236208 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0d57029f-5c01-49cb-b4b2-ffa00210d8c6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:12.379308 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-0d57029f-5c01-49cb-b4b2-ffa00210d8c6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:12.393076 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-0d57029f-5c01-49cb-b4b2-ffa00210d8c6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:12.396143 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-0d57029f-5c01-49cb-b4b2-ffa00210d8c6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:12.398243 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-0d57029f-5c01-49cb-b4b2-ffa00210d8c6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1406 microversion: 2.20 time: 0.175177 May 10 17:52:12.400181 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 411/811] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:52:12 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:52:13.103539 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2f1daa64-d389-42e3-ad58-a7be218585b6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:13.104108 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2f1daa64-d389-42e3-ad58-a7be218585b6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:13.112621 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2f1daa64-d389-42e3-ad58-a7be218585b6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:13.113206 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2f1daa64-d389-42e3-ad58-a7be218585b6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:13.113861 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2f1daa64-d389-42e3-ad58-a7be218585b6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:13.114307 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2f1daa64-d389-42e3-ad58-a7be218585b6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:13.250236 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2f1daa64-d389-42e3-ad58-a7be218585b6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:13.258389 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2f1daa64-d389-42e3-ad58-a7be218585b6 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1689 microversion: 2.1 time: 0.158810 May 10 17:52:13.259151 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 401/812] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:13 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:13.421394 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-6aa7344f-5cc6-48d2-97c3-f1dea17ef4ce tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:13.422224 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-6aa7344f-5cc6-48d2-97c3-f1dea17ef4ce tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:13.429494 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6aa7344f-5cc6-48d2-97c3-f1dea17ef4ce tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:13.430025 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6aa7344f-5cc6-48d2-97c3-f1dea17ef4ce tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:13.430816 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6aa7344f-5cc6-48d2-97c3-f1dea17ef4ce tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:13.431265 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6aa7344f-5cc6-48d2-97c3-f1dea17ef4ce tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:13.660201 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6aa7344f-5cc6-48d2-97c3-f1dea17ef4ce tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:13.671748 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6aa7344f-5cc6-48d2-97c3-f1dea17ef4ce tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:13.673956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6aa7344f-5cc6-48d2-97c3-f1dea17ef4ce tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:13.675982 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-6aa7344f-5cc6-48d2-97c3-f1dea17ef4ce tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1597 microversion: 2.20 time: 0.259150 May 10 17:52:13.676788 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 412/813] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:52:13 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1597 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:52:13.701105 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-684af74d-6e41-413c-9718-7b255a5da6f0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:13.701634 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-684af74d-6e41-413c-9718-7b255a5da6f0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:13.707998 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-684af74d-6e41-413c-9718-7b255a5da6f0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:13.708461 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-684af74d-6e41-413c-9718-7b255a5da6f0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:13.709258 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-684af74d-6e41-413c-9718-7b255a5da6f0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:13.709707 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-684af74d-6e41-413c-9718-7b255a5da6f0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:13.845841 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-684af74d-6e41-413c-9718-7b255a5da6f0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.149780 May 10 17:52:13.846439 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 402/814] 10.222.0.60 () {60 vars in 1315 bytes} [Tue May 10 17:52:13 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:52:14.280478 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-117b549e-e75b-4546-bb50-2a4421ef3c44 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:14.282161 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-117b549e-e75b-4546-bb50-2a4421ef3c44 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:14.294650 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-117b549e-e75b-4546-bb50-2a4421ef3c44 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:14.295293 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-117b549e-e75b-4546-bb50-2a4421ef3c44 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:14.296891 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-117b549e-e75b-4546-bb50-2a4421ef3c44 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:14.297807 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-117b549e-e75b-4546-bb50-2a4421ef3c44 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:14.429806 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-3e8dda6a-b300-4025-afa4-16cfd55ee58d req-39993e59-fef8-4d5f-8651-522c46897241 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4553a66-9c17-4820-a5ab-1e3f45b42cb2", "name": "network-vif-deleted", "tag": "d41cfb7a-6772-4a26-bd70-17d9a9faa38c"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:52:14.448063 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-3e8dda6a-b300-4025-afa4-16cfd55ee58d req-39993e59-fef8-4d5f-8651-522c46897241 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:14.448815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-3e8dda6a-b300-4025-afa4-16cfd55ee58d req-39993e59-fef8-4d5f-8651-522c46897241 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:14.451000 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-117b549e-e75b-4546-bb50-2a4421ef3c44 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:14.463960 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-117b549e-e75b-4546-bb50-2a4421ef3c44 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 200 len: 1622 microversion: 2.1 time: 0.190790 May 10 17:52:14.466311 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 413/815] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:14 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 1622 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:14.487948 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-3e8dda6a-b300-4025-afa4-16cfd55ee58d req-39993e59-fef8-4d5f-8651-522c46897241 service nova] Creating event network-vif-deleted:d41cfb7a-6772-4a26-bd70-17d9a9faa38c for instance e4553a66-9c17-4820-a5ab-1e3f45b42cb2 on hv-cinder-84130 May 10 17:52:14.495904 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-3e8dda6a-b300-4025-afa4-16cfd55ee58d req-39993e59-fef8-4d5f-8651-522c46897241 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076622 May 10 17:52:14.497214 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 403/816] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:52:15.340933 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-b211fe7e-3004-4f94-8610-f16b06fb9939 req-488d26dd-4942-40d5-972c-cc2d016230d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e16b7603-15a8-44a4-82c9-729bedfb8ac6", "tag": "cb176284-f148-403c-b988-83b0bfbdd7dd"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:52:15.349545 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-b211fe7e-3004-4f94-8610-f16b06fb9939 req-488d26dd-4942-40d5-972c-cc2d016230d0 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:15.350295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-b211fe7e-3004-4f94-8610-f16b06fb9939 req-488d26dd-4942-40d5-972c-cc2d016230d0 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:15.362616 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-b211fe7e-3004-4f94-8610-f16b06fb9939 req-488d26dd-4942-40d5-972c-cc2d016230d0 service nova] Creating event network-changed:cb176284-f148-403c-b988-83b0bfbdd7dd for instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 on hv-cinder-84130 May 10 17:52:15.370018 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-b211fe7e-3004-4f94-8610-f16b06fb9939 req-488d26dd-4942-40d5-972c-cc2d016230d0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032254 May 10 17:52:15.370879 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 414/817] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:52:15.483225 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a5b2f44a-841d-4f01-b315-c672e0045765 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:15.483962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a5b2f44a-841d-4f01-b315-c672e0045765 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: e4553a66-9c17-4820-a5ab-1e3f45b42cb2] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:15.490251 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a5b2f44a-841d-4f01-b315-c672e0045765 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:15.490838 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a5b2f44a-841d-4f01-b315-c672e0045765 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:15.491538 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a5b2f44a-841d-4f01-b315-c672e0045765 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:15.491979 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a5b2f44a-841d-4f01-b315-c672e0045765 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:15.506408 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-a5b2f44a-841d-4f01-b315-c672e0045765 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] HTTP exception thrown: Instance e4553a66-9c17-4820-a5ab-1e3f45b42cb2 could not be found. May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a5b2f44a-841d-4f01-b315-c672e0045765 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Request method failure captured: May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 HTTP/1.1 May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqSOYGFPOd_dSxQaw1xfXQL_oNPyInp9GeEXMVahMzSoBYuT3KiscvPKi3HBhjiWcLRLnDswKdZfNWCZzA6zRi1fmpAEigHOnkwk7Hg_h3oQ0KqrQ-oT8nZjHwnyBn82tUZ647WdoHFkg0oukih8HeJ54y7rT7g4d_iUCDyYKQuR3Xs May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: ec9da2f35bcd444fa485c453103df5cc May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1659970125 May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:52:15.510141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:52:15.511892 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec9da2f35bcd444fa485c453103df5cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ec9da2f35bcd444fa485c453103df5cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ec9da2f35bcd444fa485c453103df5cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec9da2f35bcd444fa485c453103df5cc"}]}] May 10 17:52:15.511892 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1659970125 May 10 17:52:15.511892 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: ec9da2f35bcd444fa485c453103df5cc May 10 17:52:15.511892 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1659970125 May 10 17:52:15.511892 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-ServerRescueNegativeTestJSON-1659970125-project May 10 17:52:15.511892 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:52:15.511892 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:52:15.511892 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: 93f2755bf7ac430f9380bf2cf3ecb97f May 10 17:52:15.511892 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1659970125-project May 10 17:52:15.511892 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:52:15.511892 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance e4553a66-9c17-4820-a5ab-1e3f45b42cb2 could not be found. May 10 17:52:15.511892 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': 'e4553a66-9c17-4820-a5ab-1e3f45b42cb2'} May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4553a66-9c17-4820-a5ab-1e3f45b42cb2 could not be found. May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:52:15.512936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:52:15.514295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:52:15.514295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:52:15.514295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:52:15.514295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:52:15.514295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:52:15.514295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:52:15.514295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:52:15.514295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4553a66-9c17-4820-a5ab-1e3f45b42cb2 could not be found. May 10 17:52:15.514295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:52:15.514295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:52:15.514295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:52:15.514295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:52:15.514295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:52:15.514295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:52:15.514295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:52:15.514295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:52:15.514295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4553a66-9c17-4820-a5ab-1e3f45b42cb2 could not be found. May 10 17:52:15.514295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:52:15.520314 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a5b2f44a-841d-4f01-b315-c672e0045765 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Returning 404 to user: Instance e4553a66-9c17-4820-a5ab-1e3f45b42cb2 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:52:15.521423 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a5b2f44a-841d-4f01-b315-c672e0045765 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2" status: 404 len: 111 microversion: 2.1 time: 0.043162 May 10 17:52:15.525525 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 404/818] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:15 2022] GET /compute/v2.1/servers/e4553a66-9c17-4820-a5ab-1e3f45b42cb2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:52:15.531587 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c71ebb5c-a4e0-48eb-9074-c4eb6583c87f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '.version_select at 0x7f3e7ba9e670>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:15.557359 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c71ebb5c-a4e0-48eb-9074-c4eb6583c87f tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631421927" status: 202 len: 0 microversion: 2.1 time: 0.030570 May 10 17:52:15.558173 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 415/819] 10.222.0.60 () {58 vars in 1220 bytes} [Tue May 10 17:52:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631421927 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 17:52:18.592438 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d87ffe27-82bc-4042-af0e-0cd340d473be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:18.593039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d87ffe27-82bc-4042-af0e-0cd340d473be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:18.599761 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d87ffe27-82bc-4042-af0e-0cd340d473be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:18.600223 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d87ffe27-82bc-4042-af0e-0cd340d473be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:18.601010 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d87ffe27-82bc-4042-af0e-0cd340d473be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:18.601456 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d87ffe27-82bc-4042-af0e-0cd340d473be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:18.627443 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d87ffe27-82bc-4042-af0e-0cd340d473be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:52:18.709381 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d87ffe27-82bc-4042-af0e-0cd340d473be tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "DELETE /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 204 len: 0 microversion: 2.1 time: 0.120532 May 10 17:52:18.710007 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 405/820] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:52:18 2022] DELETE /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:52:18.718867 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-49e390f6-7e0e-430d-b8db-4dd9b094e210 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:18.719983 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-49e390f6-7e0e-430d-b8db-4dd9b094e210 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:18.727132 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-49e390f6-7e0e-430d-b8db-4dd9b094e210 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:18.727621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-49e390f6-7e0e-430d-b8db-4dd9b094e210 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:18.728413 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-49e390f6-7e0e-430d-b8db-4dd9b094e210 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:18.728856 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-49e390f6-7e0e-430d-b8db-4dd9b094e210 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:18.870998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-49e390f6-7e0e-430d-b8db-4dd9b094e210 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:18.878806 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-49e390f6-7e0e-430d-b8db-4dd9b094e210 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1507 microversion: 2.1 time: 0.163881 May 10 17:52:18.879406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 416/821] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:18 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:19.897854 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-34943005-1536-4d77-a643-c3180d92fdaa tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:19.898565 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-34943005-1536-4d77-a643-c3180d92fdaa tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:19.905533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34943005-1536-4d77-a643-c3180d92fdaa tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:19.905991 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34943005-1536-4d77-a643-c3180d92fdaa tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:19.906807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34943005-1536-4d77-a643-c3180d92fdaa tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:19.907340 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34943005-1536-4d77-a643-c3180d92fdaa tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:20.107124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-34943005-1536-4d77-a643-c3180d92fdaa tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:20.115623 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-34943005-1536-4d77-a643-c3180d92fdaa tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 200 len: 1507 microversion: 2.1 time: 0.222020 May 10 17:52:20.116177 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 406/822] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:19 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:20.249047 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-a5dce7ac-4ce6-486d-bc18-ea2972c6c313 req-59014c03-d7fd-4cf4-8441-88066fb29aac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d577a65c-d60c-4d64-a506-89ea984fe255", "name": "network-vif-deleted", "tag": "bc6ac4c5-c4f8-4e9e-abbf-8071b383eb36"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:52:20.259848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-a5dce7ac-4ce6-486d-bc18-ea2972c6c313 req-59014c03-d7fd-4cf4-8441-88066fb29aac service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:20.260325 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-a5dce7ac-4ce6-486d-bc18-ea2972c6c313 req-59014c03-d7fd-4cf4-8441-88066fb29aac service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:20.272223 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-a5dce7ac-4ce6-486d-bc18-ea2972c6c313 req-59014c03-d7fd-4cf4-8441-88066fb29aac service nova] Creating event network-vif-deleted:bc6ac4c5-c4f8-4e9e-abbf-8071b383eb36 for instance d577a65c-d60c-4d64-a506-89ea984fe255 on hv-cinder-84130 May 10 17:52:20.283414 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-a5dce7ac-4ce6-486d-bc18-ea2972c6c313 req-59014c03-d7fd-4cf4-8441-88066fb29aac service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038098 May 10 17:52:20.284372 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 417/823] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:52:21.132665 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2fa3f36e-e6de-473f-b3c1-0c8dcf6e29c2 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:21.133681 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2fa3f36e-e6de-473f-b3c1-0c8dcf6e29c2 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: d577a65c-d60c-4d64-a506-89ea984fe255] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:21.139755 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2fa3f36e-e6de-473f-b3c1-0c8dcf6e29c2 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:21.140208 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2fa3f36e-e6de-473f-b3c1-0c8dcf6e29c2 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:21.140989 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2fa3f36e-e6de-473f-b3c1-0c8dcf6e29c2 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:21.141424 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2fa3f36e-e6de-473f-b3c1-0c8dcf6e29c2 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:21.156911 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-2fa3f36e-e6de-473f-b3c1-0c8dcf6e29c2 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] HTTP exception thrown: Instance d577a65c-d60c-4d64-a506-89ea984fe255 could not be found. May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2fa3f36e-e6de-473f-b3c1-0c8dcf6e29c2 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Request method failure captured: May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 HTTP/1.1 May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqSOYGFPOd_dSxQaw1xfXQL_oNPyInp9GeEXMVahMzSoBYuT3KiscvPKi3HBhjiWcLRLnDswKdZfNWCZzA6zRi1fmpAEigHOnkwk7Hg_h3oQ0KqrQ-oT8nZjHwnyBn82tUZ647WdoHFkg0oukih8HeJ54y7rT7g4d_iUCDyYKQuR3Xs May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: ec9da2f35bcd444fa485c453103df5cc May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1659970125 May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:52:21.158733 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:52:21.160252 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec9da2f35bcd444fa485c453103df5cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ec9da2f35bcd444fa485c453103df5cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ec9da2f35bcd444fa485c453103df5cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec9da2f35bcd444fa485c453103df5cc"}]}] May 10 17:52:21.160252 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1659970125 May 10 17:52:21.160252 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: ec9da2f35bcd444fa485c453103df5cc May 10 17:52:21.160252 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1659970125 May 10 17:52:21.160252 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-ServerRescueNegativeTestJSON-1659970125-project May 10 17:52:21.160252 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:52:21.160252 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:52:21.160252 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: 93f2755bf7ac430f9380bf2cf3ecb97f May 10 17:52:21.160252 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1659970125-project May 10 17:52:21.160252 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:52:21.160252 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance d577a65c-d60c-4d64-a506-89ea984fe255 could not be found. May 10 17:52:21.160252 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': 'd577a65c-d60c-4d64-a506-89ea984fe255'} May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d577a65c-d60c-4d64-a506-89ea984fe255 could not be found. May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:52:21.161080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:52:21.162571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:52:21.162571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:52:21.162571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:52:21.162571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:52:21.162571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:52:21.162571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:52:21.162571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:52:21.162571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d577a65c-d60c-4d64-a506-89ea984fe255 could not be found. May 10 17:52:21.162571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:52:21.162571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:52:21.162571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:52:21.162571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:52:21.162571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:52:21.162571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:52:21.162571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:52:21.162571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:52:21.162571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d577a65c-d60c-4d64-a506-89ea984fe255 could not be found. May 10 17:52:21.162571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:52:21.164683 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2fa3f36e-e6de-473f-b3c1-0c8dcf6e29c2 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Returning 404 to user: Instance d577a65c-d60c-4d64-a506-89ea984fe255 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:52:21.164683 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2fa3f36e-e6de-473f-b3c1-0c8dcf6e29c2 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255" status: 404 len: 111 microversion: 2.1 time: 0.031508 May 10 17:52:21.164683 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 407/824] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:21 2022] GET /compute/v2.1/servers/d577a65c-d60c-4d64-a506-89ea984fe255 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:52:21.169436 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-75cde77f-b3d7-4d3a-ab3a-e9c7ff94c5ef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:21.170011 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-75cde77f-b3d7-4d3a-ab3a-e9c7ff94c5ef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:21.177934 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-75cde77f-b3d7-4d3a-ab3a-e9c7ff94c5ef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:21.178386 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-75cde77f-b3d7-4d3a-ab3a-e9c7ff94c5ef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:21.179160 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-75cde77f-b3d7-4d3a-ab3a-e9c7ff94c5ef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:21.179635 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-75cde77f-b3d7-4d3a-ab3a-e9c7ff94c5ef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:21.206548 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-75cde77f-b3d7-4d3a-ab3a-e9c7ff94c5ef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Going to try to terminate instance {{(pid=123753) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:52:21.286930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-75cde77f-b3d7-4d3a-ab3a-e9c7ff94c5ef tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "DELETE /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 204 len: 0 microversion: 2.1 time: 0.120555 May 10 17:52:21.288094 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 418/825] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:52:21 2022] DELETE /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:52:21.296531 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d8ee8718-4663-482a-a8a8-9cbdb8cc1e54 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:21.297153 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d8ee8718-4663-482a-a8a8-9cbdb8cc1e54 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:21.303356 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d8ee8718-4663-482a-a8a8-9cbdb8cc1e54 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:21.303816 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d8ee8718-4663-482a-a8a8-9cbdb8cc1e54 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:21.304596 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d8ee8718-4663-482a-a8a8-9cbdb8cc1e54 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:21.305080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d8ee8718-4663-482a-a8a8-9cbdb8cc1e54 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:21.447040 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d8ee8718-4663-482a-a8a8-9cbdb8cc1e54 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:21.455309 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d8ee8718-4663-482a-a8a8-9cbdb8cc1e54 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.162821 May 10 17:52:21.455959 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 408/826] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:21 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:22.474538 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-3c695f25-c16a-4900-b3a3-d5f5d9276c8e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:22.475230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-3c695f25-c16a-4900-b3a3-d5f5d9276c8e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:22.482082 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3c695f25-c16a-4900-b3a3-d5f5d9276c8e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:22.482528 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3c695f25-c16a-4900-b3a3-d5f5d9276c8e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:22.483287 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3c695f25-c16a-4900-b3a3-d5f5d9276c8e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:22.483746 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3c695f25-c16a-4900-b3a3-d5f5d9276c8e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:22.619338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-3c695f25-c16a-4900-b3a3-d5f5d9276c8e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:22.627811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-3c695f25-c16a-4900-b3a3-d5f5d9276c8e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.157382 May 10 17:52:22.628386 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 419/827] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:22 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:23.645062 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-19d2f512-2ed7-4911-acc0-0c6ea1a3caf4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:23.645681 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-19d2f512-2ed7-4911-acc0-0c6ea1a3caf4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:23.652258 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19d2f512-2ed7-4911-acc0-0c6ea1a3caf4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:23.652705 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19d2f512-2ed7-4911-acc0-0c6ea1a3caf4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:23.653474 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19d2f512-2ed7-4911-acc0-0c6ea1a3caf4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:23.653913 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19d2f512-2ed7-4911-acc0-0c6ea1a3caf4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:23.781318 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-19d2f512-2ed7-4911-acc0-0c6ea1a3caf4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:23.788594 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-19d2f512-2ed7-4911-acc0-0c6ea1a3caf4 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1521 microversion: 2.1 time: 0.147551 May 10 17:52:23.789152 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 409/828] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:23 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:24.807511 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-092c736c-9434-485d-938a-2d99ed0bdc34 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:24.808283 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-092c736c-9434-485d-938a-2d99ed0bdc34 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:24.815621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-092c736c-9434-485d-938a-2d99ed0bdc34 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:24.816109 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-092c736c-9434-485d-938a-2d99ed0bdc34 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:24.816918 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-092c736c-9434-485d-938a-2d99ed0bdc34 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:24.817350 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-092c736c-9434-485d-938a-2d99ed0bdc34 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:24.996242 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-092c736c-9434-485d-938a-2d99ed0bdc34 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93f2755bf7ac430f9380bf2cf3ecb97f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec9da2f35bcd444fa485c453103df5cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:25.004146 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-092c736c-9434-485d-938a-2d99ed0bdc34 tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 200 len: 1479 microversion: 2.1 time: 0.201198 May 10 17:52:25.004727 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 420/829] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:24 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 1479 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:25.050071 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-0dc6e0e4-5d8d-4c3e-a785-35329eda9717 req-dca1fe1f-fd57-4f0a-8cbc-cdc720687ae6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bf8bc9-b3de-4555-8835-15dd3a89bc56", "name": "network-vif-deleted", "tag": "552e62e9-0e95-4838-9c01-aa3425c6c9c6"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:52:25.060567 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-0dc6e0e4-5d8d-4c3e-a785-35329eda9717 req-dca1fe1f-fd57-4f0a-8cbc-cdc720687ae6 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:25.061061 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-0dc6e0e4-5d8d-4c3e-a785-35329eda9717 req-dca1fe1f-fd57-4f0a-8cbc-cdc720687ae6 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:25.076073 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-0dc6e0e4-5d8d-4c3e-a785-35329eda9717 req-dca1fe1f-fd57-4f0a-8cbc-cdc720687ae6 service nova] Creating event network-vif-deleted:552e62e9-0e95-4838-9c01-aa3425c6c9c6 for instance c1bf8bc9-b3de-4555-8835-15dd3a89bc56 on hv-cinder-84130 May 10 17:52:25.083435 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-0dc6e0e4-5d8d-4c3e-a785-35329eda9717 req-dca1fe1f-fd57-4f0a-8cbc-cdc720687ae6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040820 May 10 17:52:25.084155 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 410/830] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:52:26.022200 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ecd0f6e7-e87d-40a8-8ffc-3b300408262e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:26.022869 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ecd0f6e7-e87d-40a8-8ffc-3b300408262e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] [instance: c1bf8bc9-b3de-4555-8835-15dd3a89bc56] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:26.030470 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ecd0f6e7-e87d-40a8-8ffc-3b300408262e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:26.030936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ecd0f6e7-e87d-40a8-8ffc-3b300408262e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:26.031760 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ecd0f6e7-e87d-40a8-8ffc-3b300408262e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:26.032203 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ecd0f6e7-e87d-40a8-8ffc-3b300408262e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:26.047164 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-ecd0f6e7-e87d-40a8-8ffc-3b300408262e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] HTTP exception thrown: Instance c1bf8bc9-b3de-4555-8835-15dd3a89bc56 could not be found. May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ecd0f6e7-e87d-40a8-8ffc-3b300408262e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Request method failure captured: May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 HTTP/1.1 May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqSOYGFPOd_dSxQaw1xfXQL_oNPyInp9GeEXMVahMzSoBYuT3KiscvPKi3HBhjiWcLRLnDswKdZfNWCZzA6zRi1fmpAEigHOnkwk7Hg_h3oQ0KqrQ-oT8nZjHwnyBn82tUZ647WdoHFkg0oukih8HeJ54y7rT7g4d_iUCDyYKQuR3Xs May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: ec9da2f35bcd444fa485c453103df5cc May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1659970125 May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:52:26.048866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:52:26.050425 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec9da2f35bcd444fa485c453103df5cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/ec9da2f35bcd444fa485c453103df5cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_ec9da2f35bcd444fa485c453103df5cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/ec9da2f35bcd444fa485c453103df5cc"}]}] May 10 17:52:26.050425 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1659970125 May 10 17:52:26.050425 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: ec9da2f35bcd444fa485c453103df5cc May 10 17:52:26.050425 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1659970125 May 10 17:52:26.050425 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-ServerRescueNegativeTestJSON-1659970125-project May 10 17:52:26.050425 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:52:26.050425 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:52:26.050425 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: 93f2755bf7ac430f9380bf2cf3ecb97f May 10 17:52:26.050425 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1659970125-project May 10 17:52:26.050425 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:52:26.050425 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance c1bf8bc9-b3de-4555-8835-15dd3a89bc56 could not be found. May 10 17:52:26.050425 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': 'c1bf8bc9-b3de-4555-8835-15dd3a89bc56'} May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1bf8bc9-b3de-4555-8835-15dd3a89bc56 could not be found. May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:52:26.051313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:52:26.052751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:52:26.052751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:52:26.052751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:52:26.052751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:52:26.052751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:52:26.052751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:52:26.052751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:52:26.052751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1bf8bc9-b3de-4555-8835-15dd3a89bc56 could not be found. May 10 17:52:26.052751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:52:26.052751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:52:26.052751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:52:26.052751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:52:26.052751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:52:26.052751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:52:26.052751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:52:26.052751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:52:26.052751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1bf8bc9-b3de-4555-8835-15dd3a89bc56 could not be found. May 10 17:52:26.052751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:52:26.054048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ecd0f6e7-e87d-40a8-8ffc-3b300408262e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] Returning 404 to user: Instance c1bf8bc9-b3de-4555-8835-15dd3a89bc56 could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:52:26.054048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ecd0f6e7-e87d-40a8-8ffc-3b300408262e tempest-ServerRescueNegativeTestJSON-1659970125 tempest-ServerRescueNegativeTestJSON-1659970125-project] 10.222.0.60 "GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56" status: 404 len: 111 microversion: 2.1 time: 0.032183 May 10 17:52:26.054048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 421/831] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:26 2022] GET /compute/v2.1/servers/c1bf8bc9-b3de-4555-8835-15dd3a89bc56 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 17:52:35.615118 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-510d1057-eb21-4790-99a3-a237df6816fa tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Action: 'create', calling method: .version_select at 0x7f3e768e80d0>, body: {"keypair": {"name": "tempest-keypair-734244225", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMizK6GErf7hJ9qN7LHboJj8Oc0Yp40vaLPfT4UrQchKO4VXNeFSpEbsf9PhmrN2/awdeubhgpalqAarhvSGApmBiqiRCAHDxxeZCR0MwhiETfCmSITJMd0KQuEeKEeghw=="}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:52:35.629423 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-510d1057-eb21-4790-99a3-a237df6816fa tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Getting quotas for project a83ced38e3ea471399fe49b3162b38e7. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:52:35.633524 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-510d1057-eb21-4790-99a3-a237df6816fa tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Getting quotas for user 6a1dcd8a84cf4f33b5405ad0279bf2b4 and project a83ced38e3ea471399fe49b3162b38e7. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:52:35.657660 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-510d1057-eb21-4790-99a3-a237df6816fa tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.170413 May 10 17:52:35.658298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 411/832] 10.222.0.60 () {60 vars in 1158 bytes} [Tue May 10 17:52:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:52:36.171113 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-d629f9cb-4983-4137-af5a-d5e47449c464 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1770949354"}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:52:36.171757 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-d629f9cb-4983-4137-af5a-d5e47449c464 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:36.178400 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d629f9cb-4983-4137-af5a-d5e47449c464 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:36.178856 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d629f9cb-4983-4137-af5a-d5e47449c464 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:36.179672 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d629f9cb-4983-4137-af5a-d5e47449c464 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:36.180357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d629f9cb-4983-4137-af5a-d5e47449c464 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:36.344729 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.network.security_group_api [None req-d629f9cb-4983-4137-af5a-d5e47449c464 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Removing security group 8efa01d5-e8fd-47b7-b10c-1647c0ca187c from port f023603c-ec90-40f8-beef-59e8c9f7f17f May 10 17:52:36.777117 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-d629f9cb-4983-4137-af5a-d5e47449c464 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "POST /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb/action" status: 202 len: 0 microversion: 2.1 time: 0.609997 May 10 17:52:36.778032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 422/833] 10.222.0.60 () {60 vars in 1277 bytes} [Tue May 10 17:52:36 2022] POST /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb/action => generated 0 bytes in 612 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:52:36.808062 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-7b95d09a-f61b-4de7-a8b3-8e91b64f15a8 req-84b6d489-c311-46ce-973a-59a2a08d3567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab1a9bd-b249-4f09-9264-87eb2a4878cb", "tag": "f023603c-ec90-40f8-beef-59e8c9f7f17f"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:52:36.839309 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-7b95d09a-f61b-4de7-a8b3-8e91b64f15a8 req-84b6d489-c311-46ce-973a-59a2a08d3567 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:36.840871 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-7b95d09a-f61b-4de7-a8b3-8e91b64f15a8 req-84b6d489-c311-46ce-973a-59a2a08d3567 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:36.859786 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-7b95d09a-f61b-4de7-a8b3-8e91b64f15a8 req-84b6d489-c311-46ce-973a-59a2a08d3567 service nova] Creating event network-changed:f023603c-ec90-40f8-beef-59e8c9f7f17f for instance 4ab1a9bd-b249-4f09-9264-87eb2a4878cb on hv-cinder-84130 May 10 17:52:36.868100 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-7b95d09a-f61b-4de7-a8b3-8e91b64f15a8 req-84b6d489-c311-46ce-973a-59a2a08d3567 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063305 May 10 17:52:36.868712 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 412/834] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:52:37.232179 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-81a512f3-35e6-438a-a82e-bb68e7d45112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1866804100", "imageRef": "a7737c62-8029-44aa-8da7-e46fea7607fb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6723a7dd-891c-4580-9df3-21c9f6f08046"}], "security_groups": [{"name": "tempest-securitygroup--2127011062"}], "key_name": "tempest-keypair-734244225", "user_data": "}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:52:37.440588 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.network.neutron [None req-81a512f3-35e6-438a-a82e-bb68e7d45112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] validate_networks() for [('6723a7dd-891c-4580-9df3-21c9f6f08046', None, None, None, None, None)] {{(pid=123753) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:52:38.623557 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-81a512f3-35e6-438a-a82e-bb68e7d45112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Flavor limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:52:38.624692 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-81a512f3-35e6-438a-a82e-bb68e7d45112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Image limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:52:38.625174 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-81a512f3-35e6-438a-a82e-bb68e7d45112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Flavor pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:52:38.625589 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-81a512f3-35e6-438a-a82e-bb68e7d45112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Image pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:52:38.626004 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-81a512f3-35e6-438a-a82e-bb68e7d45112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:52:38.636012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-81a512f3-35e6-438a-a82e-bb68e7d45112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:38.636468 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-81a512f3-35e6-438a-a82e-bb68e7d45112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:38.637502 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-81a512f3-35e6-438a-a82e-bb68e7d45112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:38.637939 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-81a512f3-35e6-438a-a82e-bb68e7d45112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:38.657714 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-81a512f3-35e6-438a-a82e-bb68e7d45112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Getting quotas for project a83ced38e3ea471399fe49b3162b38e7. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:52:38.662933 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-81a512f3-35e6-438a-a82e-bb68e7d45112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Getting quotas for user 6a1dcd8a84cf4f33b5405ad0279bf2b4 and project a83ced38e3ea471399fe49b3162b38e7. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:52:38.675352 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-81a512f3-35e6-438a-a82e-bb68e7d45112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Going to run 1 instances... {{(pid=123753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:52:38.677770 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-81a512f3-35e6-438a-a82e-bb68e7d45112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7737c62-8029-44aa-8da7-e46fea7607fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:52:38.728783 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-81a512f3-35e6-438a-a82e-bb68e7d45112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.502731 May 10 17:52:38.729772 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 423/835] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 17:52:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 1504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:52:38.740906 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-efd9a6c8-ca59-42a5-ad36-cde536c2029c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:38.742785 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-efd9a6c8-ca59-42a5-ad36-cde536c2029c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:38.850569 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-efd9a6c8-ca59-42a5-ad36-cde536c2029c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:38.865097 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-efd9a6c8-ca59-42a5-ad36-cde536c2029c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1237 microversion: 2.1 time: 0.128101 May 10 17:52:38.866687 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 413/836] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:38 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1237 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:39.662062 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c055a796-f6d1-4e2d-a778-06fd7874efe7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:39.662579 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c055a796-f6d1-4e2d-a778-06fd7874efe7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:39.665645 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-e99241dd-e2f0-41f9-a16b-cea1f17f7ef7 req-b266dd7d-c2a9-4e89-859b-78ef240a0ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ab1a9bd-b249-4f09-9264-87eb2a4878cb", "tag": "f023603c-ec90-40f8-beef-59e8c9f7f17f"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:52:39.675094 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c055a796-f6d1-4e2d-a778-06fd7874efe7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:39.675862 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c055a796-f6d1-4e2d-a778-06fd7874efe7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:39.677425 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c055a796-f6d1-4e2d-a778-06fd7874efe7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:39.678067 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c055a796-f6d1-4e2d-a778-06fd7874efe7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:39.683919 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-e99241dd-e2f0-41f9-a16b-cea1f17f7ef7 req-b266dd7d-c2a9-4e89-859b-78ef240a0ce5 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:39.684577 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-e99241dd-e2f0-41f9-a16b-cea1f17f7ef7 req-b266dd7d-c2a9-4e89-859b-78ef240a0ce5 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:39.698547 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-e99241dd-e2f0-41f9-a16b-cea1f17f7ef7 req-b266dd7d-c2a9-4e89-859b-78ef240a0ce5 service nova] Creating event network-changed:f023603c-ec90-40f8-beef-59e8c9f7f17f for instance 4ab1a9bd-b249-4f09-9264-87eb2a4878cb on hv-cinder-84130 May 10 17:52:39.704667 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-e99241dd-e2f0-41f9-a16b-cea1f17f7ef7 req-b266dd7d-c2a9-4e89-859b-78ef240a0ce5 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043836 May 10 17:52:39.705936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 414/837] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:52:39.783703 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.objects.instance [None req-c055a796-f6d1-4e2d-a778-06fd7874efe7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lazy-loading 'services' on Instance uuid 4ab1a9bd-b249-4f09-9264-87eb2a4878cb {{(pid=123753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:52:39.879684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c055a796-f6d1-4e2d-a778-06fd7874efe7 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb/os-volume_attachments/cc21f73b-9d3e-45b7-900e-8355407f13fe" status: 202 len: 0 microversion: 2.1 time: 0.221947 May 10 17:52:39.881492 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 424/838] 10.222.0.60 () {58 vars in 1415 bytes} [Tue May 10 17:52:39 2022] DELETE /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb/os-volume_attachments/cc21f73b-9d3e-45b7-900e-8355407f13fe => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:52:39.887900 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4b02b76d-0551-47cf-bbea-648d0806388c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:39.889421 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4b02b76d-0551-47cf-bbea-648d0806388c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:39.893723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8486ca73-5f5d-467d-be0c-9bc8e57ef598 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:39.894992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8486ca73-5f5d-467d-be0c-9bc8e57ef598 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:39.898943 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4b02b76d-0551-47cf-bbea-648d0806388c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:39.900470 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4b02b76d-0551-47cf-bbea-648d0806388c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:39.902274 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4b02b76d-0551-47cf-bbea-648d0806388c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:39.903408 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4b02b76d-0551-47cf-bbea-648d0806388c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:39.929275 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8486ca73-5f5d-467d-be0c-9bc8e57ef598 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:39.929859 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8486ca73-5f5d-467d-be0c-9bc8e57ef598 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:39.930876 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8486ca73-5f5d-467d-be0c-9bc8e57ef598 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:39.931543 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8486ca73-5f5d-467d-be0c-9bc8e57ef598 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:39.984586 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8486ca73-5f5d-467d-be0c-9bc8e57ef598 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098715 May 10 17:52:39.985556 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 425/839] 10.222.0.60 () {58 vars in 1301 bytes} [Tue May 10 17:52:39 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:52:40.006419 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4b02b76d-0551-47cf-bbea-648d0806388c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:40.015143 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4b02b76d-0551-47cf-bbea-648d0806388c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1289 microversion: 2.1 time: 0.135408 May 10 17:52:40.016209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 415/840] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:39 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1289 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:52:41.006587 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-0f48e237-b929-4ee4-9a9c-1df57208d8b6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:41.011058 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-0f48e237-b929-4ee4-9a9c-1df57208d8b6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:41.028396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0f48e237-b929-4ee4-9a9c-1df57208d8b6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:41.028396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0f48e237-b929-4ee4-9a9c-1df57208d8b6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:41.029213 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0f48e237-b929-4ee4-9a9c-1df57208d8b6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:41.030206 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0f48e237-b929-4ee4-9a9c-1df57208d8b6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:41.033661 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-96842847-f369-4804-8ccb-64d99a572920 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:41.034359 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-96842847-f369-4804-8ccb-64d99a572920 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:41.042411 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-96842847-f369-4804-8ccb-64d99a572920 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:41.043178 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-96842847-f369-4804-8ccb-64d99a572920 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:41.044506 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-96842847-f369-4804-8ccb-64d99a572920 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:41.045064 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-96842847-f369-4804-8ccb-64d99a572920 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:41.106868 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-0f48e237-b929-4ee4-9a9c-1df57208d8b6 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110983 May 10 17:52:41.107974 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 426/841] 10.222.0.60 () {58 vars in 1301 bytes} [Tue May 10 17:52:40 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:52:41.121440 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-96842847-f369-4804-8ccb-64d99a572920 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:41.129886 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-96842847-f369-4804-8ccb-64d99a572920 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1295 microversion: 2.1 time: 0.100013 May 10 17:52:41.130744 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 416/842] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:41 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1295 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:42.119713 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7cee88c3-2fb4-41ce-8d1a-2a519921b044 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:42.120572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7cee88c3-2fb4-41ce-8d1a-2a519921b044 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:42.127691 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7cee88c3-2fb4-41ce-8d1a-2a519921b044 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:42.128142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7cee88c3-2fb4-41ce-8d1a-2a519921b044 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:42.129135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7cee88c3-2fb4-41ce-8d1a-2a519921b044 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:42.129583 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7cee88c3-2fb4-41ce-8d1a-2a519921b044 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:42.149840 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-46e26272-1e06-4062-886c-cc17b6741c1f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:42.150718 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-46e26272-1e06-4062-886c-cc17b6741c1f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:42.164828 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-46e26272-1e06-4062-886c-cc17b6741c1f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:42.165659 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-46e26272-1e06-4062-886c-cc17b6741c1f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:42.168297 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-46e26272-1e06-4062-886c-cc17b6741c1f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:42.177381 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-46e26272-1e06-4062-886c-cc17b6741c1f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:42.197118 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7cee88c3-2fb4-41ce-8d1a-2a519921b044 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.082163 May 10 17:52:42.197968 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 427/843] 10.222.0.60 () {58 vars in 1301 bytes} [Tue May 10 17:52:42 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:52:42.211596 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ca9c5aeb-8bfb-4276-8ab3-9e3ea7cbd058 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:42.212186 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ca9c5aeb-8bfb-4276-8ab3-9e3ea7cbd058 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:42.219902 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ca9c5aeb-8bfb-4276-8ab3-9e3ea7cbd058 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:42.220651 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ca9c5aeb-8bfb-4276-8ab3-9e3ea7cbd058 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:42.221623 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ca9c5aeb-8bfb-4276-8ab3-9e3ea7cbd058 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:42.222063 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ca9c5aeb-8bfb-4276-8ab3-9e3ea7cbd058 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:42.308787 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-ca9c5aeb-8bfb-4276-8ab3-9e3ea7cbd058 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] HTTP exception thrown: Instance 4ab1a9bd-b249-4f09-9264-87eb2a4878cb is not attached to volume cc21f73b-9d3e-45b7-900e-8355407f13fe May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ca9c5aeb-8bfb-4276-8ab3-9e3ea7cbd058 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Request method failure captured: May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: DELETE /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb/os-volume_attachments/cc21f73b-9d3e-45b7-900e-8355407f13fe HTTP/1.1 May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqVYhOUlV6ZKHWGKVUyK2kykos503f70i64CGvTLCNkgbvIambGAMu-lTP7RTaGOqg0W_BwoyKgFwdAIjljL1L4dqynYhzwZbi1cO0FZZcXc8YsTdnPRMMrM4Z00PWyjU4GukjNgRoL2pNbQStFuXc5UOK3XkVYzTU-7On-OGPhevAY May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: f582fd9ef9094e8f9b47f7e686e3808a May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-TestMinimumBasicScenario-1856724445 May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:52:42.317013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:52:42.318446 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f582fd9ef9094e8f9b47f7e686e3808a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f582fd9ef9094e8f9b47f7e686e3808a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f582fd9ef9094e8f9b47f7e686e3808a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f582fd9ef9094e8f9b47f7e686e3808a"}]}] May 10 17:52:42.318446 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-TestMinimumBasicScenario-1856724445 May 10 17:52:42.318446 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: f582fd9ef9094e8f9b47f7e686e3808a May 10 17:52:42.318446 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1856724445 May 10 17:52:42.318446 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-TestMinimumBasicScenario-1856724445-project May 10 17:52:42.318446 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:52:42.318446 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:52:42.318446 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: 1b437da424eb4eb2b36382912fc3e366 May 10 17:52:42.318446 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-TestMinimumBasicScenario-1856724445-project May 10 17:52:42.318446 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:52:42.318446 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance 4ab1a9bd-b249-4f09-9264-87eb2a4878cb is not attached to volume cc21f73b-9d3e-45b7-900e-8355407f13fe May 10 17:52:42.319139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'server_id': '4ab1a9bd-b249-4f09-9264-87eb2a4878cb', 'id': 'cc21f73b-9d3e-45b7-900e-8355407f13fe'} May 10 17:52:42.319139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:52:42.319139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:52:42.319139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 10 17:52:42.319139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 10 17:52:42.319139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 10 17:52:42.319139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 10 17:52:42.319139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 10 17:52:42.319139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 10 17:52:42.319139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cc21f73b-9d3e-45b7-900e-8355407f13fe. May 10 17:52:42.319139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:52:42.319139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:52:42.319139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:52:42.319139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:52:42.319139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:52:42.319139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:52:42.319139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:52:42.319139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:52:42.319139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:52:42.320994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:52:42.320994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 10 17:52:42.320994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 10 17:52:42.320994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ab1a9bd-b249-4f09-9264-87eb2a4878cb is not attached to volume cc21f73b-9d3e-45b7-900e-8355407f13fe May 10 17:52:42.320994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:52:42.320994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:52:42.320994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:52:42.320994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:52:42.320994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:52:42.320994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:52:42.320994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:52:42.320994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:52:42.320994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ab1a9bd-b249-4f09-9264-87eb2a4878cb is not attached to volume cc21f73b-9d3e-45b7-900e-8355407f13fe May 10 17:52:42.320994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:52:42.323359 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ca9c5aeb-8bfb-4276-8ab3-9e3ea7cbd058 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Returning 404 to user: Instance 4ab1a9bd-b249-4f09-9264-87eb2a4878cb is not attached to volume cc21f73b-9d3e-45b7-900e-8355407f13fe {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:52:42.324470 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ca9c5aeb-8bfb-4276-8ab3-9e3ea7cbd058 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb/os-volume_attachments/cc21f73b-9d3e-45b7-900e-8355407f13fe" status: 404 len: 154 microversion: 2.1 time: 0.117639 May 10 17:52:42.325607 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 428/844] 10.222.0.60 () {58 vars in 1415 bytes} [Tue May 10 17:52:42 2022] DELETE /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb/os-volume_attachments/cc21f73b-9d3e-45b7-900e-8355407f13fe => generated 154 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 17:52:42.333098 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-46e26272-1e06-4062-886c-cc17b6741c1f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:42.341362 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-46e26272-1e06-4062-886c-cc17b6741c1f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1363 microversion: 2.1 time: 0.195992 May 10 17:52:42.342039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 417/845] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:42 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:42.699512 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-b8db3414-c581-49a6-bc89-23a2aaafd545 req-6eae9497-5e8b-45f9-b8f5-37087dcef983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67aef06-0fe1-4ec5-a643-e51baea32b2e", "tag": "b7f4dfb8-2c4d-4c91-8b1f-6040b097f331"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:52:42.739449 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-b8db3414-c581-49a6-bc89-23a2aaafd545 req-6eae9497-5e8b-45f9-b8f5-37087dcef983 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:42.740866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-b8db3414-c581-49a6-bc89-23a2aaafd545 req-6eae9497-5e8b-45f9-b8f5-37087dcef983 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:42.762040 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-b8db3414-c581-49a6-bc89-23a2aaafd545 req-6eae9497-5e8b-45f9-b8f5-37087dcef983 service nova] Creating event network-changed:b7f4dfb8-2c4d-4c91-8b1f-6040b097f331 for instance f67aef06-0fe1-4ec5-a643-e51baea32b2e on hv-cinder-84130 May 10 17:52:42.775642 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-b8db3414-c581-49a6-bc89-23a2aaafd545 req-6eae9497-5e8b-45f9-b8f5-37087dcef983 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083870 May 10 17:52:42.776819 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 429/846] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:52:43.357894 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6c104dd9-4904-443b-af28-aa68100e1143 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:43.358429 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6c104dd9-4904-443b-af28-aa68100e1143 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:43.365243 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6c104dd9-4904-443b-af28-aa68100e1143 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:43.365704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6c104dd9-4904-443b-af28-aa68100e1143 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:43.366495 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6c104dd9-4904-443b-af28-aa68100e1143 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:43.367187 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6c104dd9-4904-443b-af28-aa68100e1143 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:43.474501 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f0a7beda-4f23-4e1a-95f3-6ea966a5d713 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:43.475743 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f0a7beda-4f23-4e1a-95f3-6ea966a5d713 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:43.482306 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f0a7beda-4f23-4e1a-95f3-6ea966a5d713 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:43.482759 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f0a7beda-4f23-4e1a-95f3-6ea966a5d713 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:43.483577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f0a7beda-4f23-4e1a-95f3-6ea966a5d713 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:43.484017 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f0a7beda-4f23-4e1a-95f3-6ea966a5d713 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:43.506073 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6c104dd9-4904-443b-af28-aa68100e1143 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:43.510650 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f0a7beda-4f23-4e1a-95f3-6ea966a5d713 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Going to try to terminate instance {{(pid=123753) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:52:43.515194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6c104dd9-4904-443b-af28-aa68100e1143 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1363 microversion: 2.1 time: 0.161260 May 10 17:52:43.515821 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 418/847] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:43 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:43.591420 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f0a7beda-4f23-4e1a-95f3-6ea966a5d713 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 204 len: 0 microversion: 2.1 time: 0.120838 May 10 17:52:43.591993 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 430/848] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:52:43 2022] DELETE /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 10 17:52:43.600072 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b11c1b5b-6647-4281-aecc-16a1da69bf32 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:43.600679 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b11c1b5b-6647-4281-aecc-16a1da69bf32 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:43.606880 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b11c1b5b-6647-4281-aecc-16a1da69bf32 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:43.607328 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b11c1b5b-6647-4281-aecc-16a1da69bf32 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:43.608234 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b11c1b5b-6647-4281-aecc-16a1da69bf32 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:43.608626 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b11c1b5b-6647-4281-aecc-16a1da69bf32 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:43.741031 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b11c1b5b-6647-4281-aecc-16a1da69bf32 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:43.749560 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b11c1b5b-6647-4281-aecc-16a1da69bf32 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1554 microversion: 2.1 time: 0.153147 May 10 17:52:43.750293 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 419/849] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:43 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:44.533138 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-6cabaaa5-5218-48bd-b081-e27a8d168631 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:44.533837 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-6cabaaa5-5218-48bd-b081-e27a8d168631 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:44.541135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6cabaaa5-5218-48bd-b081-e27a8d168631 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:44.541587 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6cabaaa5-5218-48bd-b081-e27a8d168631 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:44.542370 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6cabaaa5-5218-48bd-b081-e27a8d168631 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:44.542810 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6cabaaa5-5218-48bd-b081-e27a8d168631 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:44.690263 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6cabaaa5-5218-48bd-b081-e27a8d168631 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:44.698666 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-6cabaaa5-5218-48bd-b081-e27a8d168631 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1363 microversion: 2.1 time: 0.169677 May 10 17:52:44.699273 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 431/850] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:44 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:44.769516 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0f622d5a-c6d8-429f-808b-c0427eac2f5d tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:44.770519 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0f622d5a-c6d8-429f-808b-c0427eac2f5d tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:44.777915 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f622d5a-c6d8-429f-808b-c0427eac2f5d tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:44.778372 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f622d5a-c6d8-429f-808b-c0427eac2f5d tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:44.779153 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f622d5a-c6d8-429f-808b-c0427eac2f5d tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:44.779628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f622d5a-c6d8-429f-808b-c0427eac2f5d tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:44.912268 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0f622d5a-c6d8-429f-808b-c0427eac2f5d tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:44.919960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0f622d5a-c6d8-429f-808b-c0427eac2f5d tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1554 microversion: 2.1 time: 0.155686 May 10 17:52:44.920530 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 420/851] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:44 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:45.716287 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e4266ad4-bde1-46db-870a-15d8acfdc332 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:45.716902 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e4266ad4-bde1-46db-870a-15d8acfdc332 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:45.723614 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e4266ad4-bde1-46db-870a-15d8acfdc332 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:45.724072 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e4266ad4-bde1-46db-870a-15d8acfdc332 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:45.724846 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e4266ad4-bde1-46db-870a-15d8acfdc332 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:45.725294 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e4266ad4-bde1-46db-870a-15d8acfdc332 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:45.869146 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e4266ad4-bde1-46db-870a-15d8acfdc332 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:45.883905 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e4266ad4-bde1-46db-870a-15d8acfdc332 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1363 microversion: 2.1 time: 0.170259 May 10 17:52:45.884977 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 432/852] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:45 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:45.937176 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-37a7042a-2a7e-4c41-a618-af297a814508 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:45.937797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-37a7042a-2a7e-4c41-a618-af297a814508 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:45.944387 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-37a7042a-2a7e-4c41-a618-af297a814508 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:45.944873 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-37a7042a-2a7e-4c41-a618-af297a814508 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:45.946277 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-37a7042a-2a7e-4c41-a618-af297a814508 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:45.946730 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-37a7042a-2a7e-4c41-a618-af297a814508 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:46.088865 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-37a7042a-2a7e-4c41-a618-af297a814508 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:46.096499 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-37a7042a-2a7e-4c41-a618-af297a814508 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1554 microversion: 2.1 time: 0.163098 May 10 17:52:46.097022 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 421/853] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:45 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:46.902133 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-72fed713-f6cd-40c4-aab6-88bf947d0914 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:46.902747 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-72fed713-f6cd-40c4-aab6-88bf947d0914 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:46.909263 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-72fed713-f6cd-40c4-aab6-88bf947d0914 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:46.909713 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-72fed713-f6cd-40c4-aab6-88bf947d0914 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:46.910490 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-72fed713-f6cd-40c4-aab6-88bf947d0914 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:46.910930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-72fed713-f6cd-40c4-aab6-88bf947d0914 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:47.047719 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-72fed713-f6cd-40c4-aab6-88bf947d0914 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:47.056092 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-72fed713-f6cd-40c4-aab6-88bf947d0914 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1363 microversion: 2.1 time: 0.157864 May 10 17:52:47.065353 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 433/854] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:46 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:47.115480 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-27576d37-64ff-4fa3-b15b-60af765a6356 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:47.116290 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-27576d37-64ff-4fa3-b15b-60af765a6356 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:47.123428 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-27576d37-64ff-4fa3-b15b-60af765a6356 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:47.124046 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-27576d37-64ff-4fa3-b15b-60af765a6356 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:47.124930 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-27576d37-64ff-4fa3-b15b-60af765a6356 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:47.125448 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-27576d37-64ff-4fa3-b15b-60af765a6356 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:47.273522 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-27576d37-64ff-4fa3-b15b-60af765a6356 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:47.281555 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-27576d37-64ff-4fa3-b15b-60af765a6356 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1554 microversion: 2.1 time: 0.171117 May 10 17:52:47.282140 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 422/855] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:47 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:48.073768 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-61489837-8568-4524-980d-18d5533765e7 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:48.074402 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-61489837-8568-4524-980d-18d5533765e7 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:48.081413 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-61489837-8568-4524-980d-18d5533765e7 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:48.081869 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-61489837-8568-4524-980d-18d5533765e7 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:48.082683 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-61489837-8568-4524-980d-18d5533765e7 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:48.083148 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-61489837-8568-4524-980d-18d5533765e7 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:48.220486 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-61489837-8568-4524-980d-18d5533765e7 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:48.228371 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-61489837-8568-4524-980d-18d5533765e7 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1363 microversion: 2.1 time: 0.159400 May 10 17:52:48.228953 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 434/856] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:48 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:48.299625 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3e99d0e6-e9e2-4afa-8f3a-f2ee63fc15d1 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:48.300453 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3e99d0e6-e9e2-4afa-8f3a-f2ee63fc15d1 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:48.308403 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e99d0e6-e9e2-4afa-8f3a-f2ee63fc15d1 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:48.308403 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e99d0e6-e9e2-4afa-8f3a-f2ee63fc15d1 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:48.308825 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e99d0e6-e9e2-4afa-8f3a-f2ee63fc15d1 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:48.309280 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3e99d0e6-e9e2-4afa-8f3a-f2ee63fc15d1 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:48.565237 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3e99d0e6-e9e2-4afa-8f3a-f2ee63fc15d1 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:48.574121 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3e99d0e6-e9e2-4afa-8f3a-f2ee63fc15d1 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1554 microversion: 2.1 time: 0.278290 May 10 17:52:48.574700 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 423/857] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:48 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1554 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:48.878896 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-edf9a309-67bb-4bfb-9756-b2453940362b req-c28263e6-6d8c-4bf1-9b80-05cae35cf120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ab1a9bd-b249-4f09-9264-87eb2a4878cb", "name": "network-vif-deleted", "tag": "f023603c-ec90-40f8-beef-59e8c9f7f17f"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:52:48.887296 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-edf9a309-67bb-4bfb-9756-b2453940362b req-c28263e6-6d8c-4bf1-9b80-05cae35cf120 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:48.887768 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-edf9a309-67bb-4bfb-9756-b2453940362b req-c28263e6-6d8c-4bf1-9b80-05cae35cf120 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:48.900278 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-edf9a309-67bb-4bfb-9756-b2453940362b req-c28263e6-6d8c-4bf1-9b80-05cae35cf120 service nova] Creating event network-vif-deleted:f023603c-ec90-40f8-beef-59e8c9f7f17f for instance 4ab1a9bd-b249-4f09-9264-87eb2a4878cb on hv-cinder-84130 May 10 17:52:48.905532 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-edf9a309-67bb-4bfb-9756-b2453940362b req-c28263e6-6d8c-4bf1-9b80-05cae35cf120 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030285 May 10 17:52:48.906235 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 435/858] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:52:49.245117 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b51f4e11-fb65-4413-962e-8320216e3d4a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:49.246004 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b51f4e11-fb65-4413-962e-8320216e3d4a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:49.255090 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b51f4e11-fb65-4413-962e-8320216e3d4a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:49.255581 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b51f4e11-fb65-4413-962e-8320216e3d4a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:49.256977 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b51f4e11-fb65-4413-962e-8320216e3d4a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:49.257861 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b51f4e11-fb65-4413-962e-8320216e3d4a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:49.276830 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-1ab76ee0-5d6f-4d05-b004-1a0f5b79f209 req-bed4ac76-a616-481a-9952-662bf5ae2b10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67aef06-0fe1-4ec5-a643-e51baea32b2e", "name": "network-vif-plugged", "status": "completed", "tag": "b7f4dfb8-2c4d-4c91-8b1f-6040b097f331"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:52:49.288440 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-1ab76ee0-5d6f-4d05-b004-1a0f5b79f209 req-bed4ac76-a616-481a-9952-662bf5ae2b10 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:49.290002 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-1ab76ee0-5d6f-4d05-b004-1a0f5b79f209 req-bed4ac76-a616-481a-9952-662bf5ae2b10 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:49.306584 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-1ab76ee0-5d6f-4d05-b004-1a0f5b79f209 req-bed4ac76-a616-481a-9952-662bf5ae2b10 service nova] Creating event network-vif-plugged:b7f4dfb8-2c4d-4c91-8b1f-6040b097f331 for instance f67aef06-0fe1-4ec5-a643-e51baea32b2e on hv-cinder-84130 May 10 17:52:49.313969 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-1ab76ee0-5d6f-4d05-b004-1a0f5b79f209 req-bed4ac76-a616-481a-9952-662bf5ae2b10 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041588 May 10 17:52:49.318095 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 436/859] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:52:49.448995 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b51f4e11-fb65-4413-962e-8320216e3d4a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:49.458244 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b51f4e11-fb65-4413-962e-8320216e3d4a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1363 microversion: 2.1 time: 0.217523 May 10 17:52:49.458824 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 424/860] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:49 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1363 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:49.592770 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-554955c8-6add-45a8-972d-1f0bfbb44df4 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:49.593470 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-554955c8-6add-45a8-972d-1f0bfbb44df4 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:49.599966 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-554955c8-6add-45a8-972d-1f0bfbb44df4 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:49.600421 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-554955c8-6add-45a8-972d-1f0bfbb44df4 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:49.601200 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-554955c8-6add-45a8-972d-1f0bfbb44df4 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:49.601640 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-554955c8-6add-45a8-972d-1f0bfbb44df4 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:49.635891 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-554955c8-6add-45a8-972d-1f0bfbb44df4 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:49.636251 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-554955c8-6add-45a8-972d-1f0bfbb44df4 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:49.636713 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.objects.instance [None req-554955c8-6add-45a8-972d-1f0bfbb44df4 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lazy-loading 'fault' on Instance uuid 4ab1a9bd-b249-4f09-9264-87eb2a4878cb {{(pid=123753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:52:49.687389 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-554955c8-6add-45a8-972d-1f0bfbb44df4 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b437da424eb4eb2b36382912fc3e366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f582fd9ef9094e8f9b47f7e686e3808a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:49.698659 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-554955c8-6add-45a8-972d-1f0bfbb44df4 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 200 len: 1349 microversion: 2.1 time: 0.110071 May 10 17:52:49.699478 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 437/861] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:49 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 1349 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:50.477038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c8eff405-6a15-44b6-804b-4eda95cbad87 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:50.477713 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c8eff405-6a15-44b6-804b-4eda95cbad87 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:50.486327 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c8eff405-6a15-44b6-804b-4eda95cbad87 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:50.486734 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c8eff405-6a15-44b6-804b-4eda95cbad87 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:50.487574 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c8eff405-6a15-44b6-804b-4eda95cbad87 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:50.488026 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c8eff405-6a15-44b6-804b-4eda95cbad87 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:50.631292 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c8eff405-6a15-44b6-804b-4eda95cbad87 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:50.640988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c8eff405-6a15-44b6-804b-4eda95cbad87 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1363 microversion: 2.1 time: 0.168679 May 10 17:52:50.641659 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 425/862] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:50 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:50.716837 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-0c2401b4-58c7-4d66-874d-c4ff2b17001d tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:50.717452 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-0c2401b4-58c7-4d66-874d-c4ff2b17001d tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] [instance: 4ab1a9bd-b249-4f09-9264-87eb2a4878cb] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:50.726054 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0c2401b4-58c7-4d66-874d-c4ff2b17001d tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:50.726805 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0c2401b4-58c7-4d66-874d-c4ff2b17001d tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:50.728143 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0c2401b4-58c7-4d66-874d-c4ff2b17001d tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:50.728879 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0c2401b4-58c7-4d66-874d-c4ff2b17001d tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:50.747415 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-0c2401b4-58c7-4d66-874d-c4ff2b17001d tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] HTTP exception thrown: Instance 4ab1a9bd-b249-4f09-9264-87eb2a4878cb could not be found. May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-0c2401b4-58c7-4d66-874d-c4ff2b17001d tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Request method failure captured: May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb HTTP/1.1 May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqVYhOUlV6ZKHWGKVUyK2kykos503f70i64CGvTLCNkgbvIambGAMu-lTP7RTaGOqg0W_BwoyKgFwdAIjljL1L4dqynYhzwZbi1cO0FZZcXc8YsTdnPRMMrM4Z00PWyjU4GukjNgRoL2pNbQStFuXc5UOK3XkVYzTU-7On-OGPhevAY May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: f582fd9ef9094e8f9b47f7e686e3808a May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-TestMinimumBasicScenario-1856724445 May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:52:50.749103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:52:50.750723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f582fd9ef9094e8f9b47f7e686e3808a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f582fd9ef9094e8f9b47f7e686e3808a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f582fd9ef9094e8f9b47f7e686e3808a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f582fd9ef9094e8f9b47f7e686e3808a"}]}] May 10 17:52:50.750723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-TestMinimumBasicScenario-1856724445 May 10 17:52:50.750723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: f582fd9ef9094e8f9b47f7e686e3808a May 10 17:52:50.750723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1856724445 May 10 17:52:50.750723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-TestMinimumBasicScenario-1856724445-project May 10 17:52:50.750723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:52:50.750723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:52:50.750723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: 1b437da424eb4eb2b36382912fc3e366 May 10 17:52:50.750723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-TestMinimumBasicScenario-1856724445-project May 10 17:52:50.750723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:52:50.750723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance 4ab1a9bd-b249-4f09-9264-87eb2a4878cb could not be found. May 10 17:52:50.750723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': '4ab1a9bd-b249-4f09-9264-87eb2a4878cb'} May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ab1a9bd-b249-4f09-9264-87eb2a4878cb could not be found. May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:52:50.751526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:52:50.752882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:52:50.752882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:52:50.752882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:52:50.752882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:52:50.752882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:52:50.752882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:52:50.752882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:52:50.752882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ab1a9bd-b249-4f09-9264-87eb2a4878cb could not be found. May 10 17:52:50.752882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:52:50.752882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:52:50.752882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:52:50.752882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:52:50.752882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:52:50.752882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:52:50.752882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:52:50.752882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:52:50.752882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ab1a9bd-b249-4f09-9264-87eb2a4878cb could not be found. May 10 17:52:50.752882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:52:50.754233 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-0c2401b4-58c7-4d66-874d-c4ff2b17001d tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Returning 404 to user: Instance 4ab1a9bd-b249-4f09-9264-87eb2a4878cb could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:52:50.754233 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-0c2401b4-58c7-4d66-874d-c4ff2b17001d tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb" status: 404 len: 111 microversion: 2.1 time: 0.038300 May 10 17:52:50.754233 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 438/863] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:50 2022] GET /compute/v2.1/servers/4ab1a9bd-b249-4f09-9264-87eb2a4878cb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:52:50.761586 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e3582ae6-3a38-40c2-b6ed-4d13ccab2759 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] Calling method '.version_select at 0x7f3e767dfa60>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:50.781729 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e3582ae6-3a38-40c2-b6ed-4d13ccab2759 tempest-TestMinimumBasicScenario-1856724445 tempest-TestMinimumBasicScenario-1856724445-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1064246823" status: 202 len: 0 microversion: 2.1 time: 0.025260 May 10 17:52:50.782326 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 426/864] 10.222.0.60 () {58 vars in 1271 bytes} [Tue May 10 17:52:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1064246823 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:52:51.660667 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c4bab205-e74c-4d52-8734-7ce8f5967e33 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:51.661295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c4bab205-e74c-4d52-8734-7ce8f5967e33 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:51.669491 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c4bab205-e74c-4d52-8734-7ce8f5967e33 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:51.670938 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c4bab205-e74c-4d52-8734-7ce8f5967e33 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:51.671820 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c4bab205-e74c-4d52-8734-7ce8f5967e33 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:51.672271 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c4bab205-e74c-4d52-8734-7ce8f5967e33 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:51.900594 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c4bab205-e74c-4d52-8734-7ce8f5967e33 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:52:51.909374 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c4bab205-e74c-4d52-8734-7ce8f5967e33 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1548 microversion: 2.1 time: 0.253478 May 10 17:52:51.921004 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 439/865] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:52:51 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1548 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:52:51.928522 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5c2a441d-9ed0-48b1-82d5-c7714c343b32 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:52:51.929630 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5c2a441d-9ed0-48b1-82d5-c7714c343b32 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:52:51.936872 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5c2a441d-9ed0-48b1-82d5-c7714c343b32 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:51.937329 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5c2a441d-9ed0-48b1-82d5-c7714c343b32 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:51.938130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5c2a441d-9ed0-48b1-82d5-c7714c343b32 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:51.938581 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5c2a441d-9ed0-48b1-82d5-c7714c343b32 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:52.349384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5c2a441d-9ed0-48b1-82d5-c7714c343b32 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.426615 May 10 17:52:52.349990 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 427/866] 10.222.0.60 () {58 vars in 1274 bytes} [Tue May 10 17:52:51 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e/os-interface => generated 284 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:52:53.829285 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-f22e4b52-cc54-4883-b40f-715113260779 req-4db5fba0-7589-4c74-9af8-494077edf084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f67aef06-0fe1-4ec5-a643-e51baea32b2e", "tag": "b7f4dfb8-2c4d-4c91-8b1f-6040b097f331"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:52:53.838841 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-f22e4b52-cc54-4883-b40f-715113260779 req-4db5fba0-7589-4c74-9af8-494077edf084 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:52:53.839353 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-f22e4b52-cc54-4883-b40f-715113260779 req-4db5fba0-7589-4c74-9af8-494077edf084 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:52:53.853009 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-f22e4b52-cc54-4883-b40f-715113260779 req-4db5fba0-7589-4c74-9af8-494077edf084 service nova] Creating event network-changed:b7f4dfb8-2c4d-4c91-8b1f-6040b097f331 for instance f67aef06-0fe1-4ec5-a643-e51baea32b2e on hv-cinder-84130 May 10 17:52:53.858604 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-f22e4b52-cc54-4883-b40f-715113260779 req-4db5fba0-7589-4c74-9af8-494077edf084 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032862 May 10 17:52:53.860010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 440/867] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:53:29.749919 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ecfa9f2c-3c2f-4091-8330-f945e7b2e59e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:29.750579 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ecfa9f2c-3c2f-4091-8330-f945e7b2e59e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:29.757449 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ecfa9f2c-3c2f-4091-8330-f945e7b2e59e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:29.757905 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ecfa9f2c-3c2f-4091-8330-f945e7b2e59e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:29.758701 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ecfa9f2c-3c2f-4091-8330-f945e7b2e59e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:29.759147 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ecfa9f2c-3c2f-4091-8330-f945e7b2e59e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:29.785219 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ecfa9f2c-3c2f-4091-8330-f945e7b2e59e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49/ips" status: 200 len: 150 microversion: 2.1 time: 0.039912 May 10 17:53:29.785802 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 428/868] 10.222.0.60 () {58 vars in 1247 bytes} [Tue May 10 17:53:29 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:53:31.158040 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9ab604d1-a7e4-4b35-9556-d19a5024aa36 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4def9ce8-10b0-45a6-be74-d2cc44375c11"}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:53:31.159341 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-9ab604d1-a7e4-4b35-9556-d19a5024aa36 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:31.165959 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9ab604d1-a7e4-4b35-9556-d19a5024aa36 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:31.166416 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9ab604d1-a7e4-4b35-9556-d19a5024aa36 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:31.167200 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9ab604d1-a7e4-4b35-9556-d19a5024aa36 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:31.167666 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9ab604d1-a7e4-4b35-9556-d19a5024aa36 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:31.463192 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-9ab604d1-a7e4-4b35-9556-d19a5024aa36 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "POST /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313248 May 10 17:53:31.464387 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 441/869] 10.222.0.60 () {60 vars in 1322 bytes} [Tue May 10 17:53:31 2022] POST /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:53:39.041129 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-879f750f-ecdf-429a-b6d8-abbccd700b01 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4def9ce8-10b0-45a6-be74-d2cc44375c11"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:53:39.042225 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-879f750f-ecdf-429a-b6d8-abbccd700b01 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:39.049632 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-879f750f-ecdf-429a-b6d8-abbccd700b01 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:39.050104 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-879f750f-ecdf-429a-b6d8-abbccd700b01 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:39.050947 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-879f750f-ecdf-429a-b6d8-abbccd700b01 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:39.051436 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-879f750f-ecdf-429a-b6d8-abbccd700b01 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:39.147440 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-879f750f-ecdf-429a-b6d8-abbccd700b01 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] HTTP exception thrown: Invalid volume: volume 4def9ce8-10b0-45a6-be74-d2cc44375c11 is already attached to instances: ed2618f3-4f12-48c9-888c-814f93d1fc49 May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-879f750f-ecdf-429a-b6d8-abbccd700b01 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Request method failure captured: May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: POST /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49/os-volume_attachments HTTP/1.1 May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 74 May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqSO0xr7UIRxT3hXOmHxzovF69xIsGczVBDivdJOJBMJVORxiAfv56xQ3YabG87POPmQfFexgT58vToWwr1fhnRiMZA5-8wUr6OWagNr8GqdBYrkCpJLIa4vawh-qHLJ2BS3J-kASnH0YnEYJlsAV4sLiWMw7Cfpf3RSa_gKuZeEwB0 May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: f4e017a4040d450aad862065563ea64d May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:53:39.149266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:53:39.150774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4e017a4040d450aad862065563ea64d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4e017a4040d450aad862065563ea64d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}] May 10 17:53:39.150774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeNegativeTest-101320951 May 10 17:53:39.150774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: f4e017a4040d450aad862065563ea64d May 10 17:53:39.150774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:53:39.150774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:53:39.150774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:53:39.150774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:53:39.150774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: e6a99e5d684a48a2845d3379e7df812c May 10 17:53:39.150774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:53:39.150774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: May 10 17:53:39.150774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {"volumeAttachment": {"volumeId": "4def9ce8-10b0-45a6-be74-d2cc44375c11"}} May 10 17:53:39.150774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:53:39.151589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Invalid volume: volume 4def9ce8-10b0-45a6-be74-d2cc44375c11 is already attached to instances: ed2618f3-4f12-48c9-888c-814f93d1fc49 May 10 17:53:39.151589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'server_id': 'ed2618f3-4f12-48c9-888c-814f93d1fc49', 'body': {'volumeAttachment': {'volumeId': '4def9ce8-10b0-45a6-be74-d2cc44375c11'}}} May 10 17:53:39.151589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:53:39.151589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:53:39.151589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 10 17:53:39.151589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 10 17:53:39.151589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 10 17:53:39.151589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 10 17:53:39.151589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 10 17:53:39.151589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 10 17:53:39.151589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 10 17:53:39.151589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 10 17:53:39.151589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 10 17:53:39.151589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 10 17:53:39.151589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4def9ce8-10b0-45a6-be74-d2cc44375c11 is already attached to instances: ed2618f3-4f12-48c9-888c-814f93d1fc49 May 10 17:53:39.151589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:53:39.151589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:53:39.151589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:53:39.151589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4def9ce8-10b0-45a6-be74-d2cc44375c11 is already attached to instances: ed2618f3-4f12-48c9-888c-814f93d1fc49 May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:53:39.152823 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:53:39.154042 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:53:39.154042 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:53:39.154042 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:53:39.154042 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4def9ce8-10b0-45a6-be74-d2cc44375c11 is already attached to instances: ed2618f3-4f12-48c9-888c-814f93d1fc49 May 10 17:53:39.154042 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:53:39.154042 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-879f750f-ecdf-429a-b6d8-abbccd700b01 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Returning 400 to user: Invalid volume: volume 4def9ce8-10b0-45a6-be74-d2cc44375c11 is already attached to instances: ed2618f3-4f12-48c9-888c-814f93d1fc49 {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:53:39.154042 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-879f750f-ecdf-429a-b6d8-abbccd700b01 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "POST /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114297 May 10 17:53:39.154042 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 429/870] 10.222.0.60 () {60 vars in 1322 bytes} [Tue May 10 17:53:39 2022] POST /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 10 17:53:39.212154 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9ebd8e52-207b-4e9d-a739-a5089f311c35 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:39.212764 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-9ebd8e52-207b-4e9d-a739-a5089f311c35 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:39.219017 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9ebd8e52-207b-4e9d-a739-a5089f311c35 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:39.219503 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9ebd8e52-207b-4e9d-a739-a5089f311c35 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:39.220281 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9ebd8e52-207b-4e9d-a739-a5089f311c35 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:39.220723 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9ebd8e52-207b-4e9d-a739-a5089f311c35 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:39.302785 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.objects.instance [None req-9ebd8e52-207b-4e9d-a739-a5089f311c35 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lazy-loading 'services' on Instance uuid ed2618f3-4f12-48c9-888c-814f93d1fc49 {{(pid=123753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:53:39.382528 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-9ebd8e52-207b-4e9d-a739-a5089f311c35 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49/os-volume_attachments/4def9ce8-10b0-45a6-be74-d2cc44375c11" status: 202 len: 0 microversion: 2.1 time: 0.175776 May 10 17:53:39.383131 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 442/871] 10.222.0.60 () {58 vars in 1415 bytes} [Tue May 10 17:53:39 2022] DELETE /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49/os-volume_attachments/4def9ce8-10b0-45a6-be74-d2cc44375c11 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:53:39.391978 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4ad6413e-e9bf-4e53-8fd3-5ffdf96e754e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:39.392999 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4ad6413e-e9bf-4e53-8fd3-5ffdf96e754e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:39.400692 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4ad6413e-e9bf-4e53-8fd3-5ffdf96e754e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:39.401262 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4ad6413e-e9bf-4e53-8fd3-5ffdf96e754e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:39.402070 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4ad6413e-e9bf-4e53-8fd3-5ffdf96e754e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:39.402543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4ad6413e-e9bf-4e53-8fd3-5ffdf96e754e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:39.434997 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4ad6413e-e9bf-4e53-8fd3-5ffdf96e754e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047032 May 10 17:53:39.435593 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 430/872] 10.222.0.60 () {58 vars in 1301 bytes} [Tue May 10 17:53:39 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:53:40.447683 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8451af0a-8edb-4970-8ef4-645d942a598e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:40.449194 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8451af0a-8edb-4970-8ef4-645d942a598e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:40.456389 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8451af0a-8edb-4970-8ef4-645d942a598e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:40.456842 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8451af0a-8edb-4970-8ef4-645d942a598e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:40.457626 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8451af0a-8edb-4970-8ef4-645d942a598e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:40.458063 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8451af0a-8edb-4970-8ef4-645d942a598e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:40.490069 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8451af0a-8edb-4970-8ef4-645d942a598e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047009 May 10 17:53:40.491291 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 443/873] 10.222.0.60 () {58 vars in 1301 bytes} [Tue May 10 17:53:40 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:53:40.561800 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-29497f9a-88d4-40f5-9c46-c03397e458b8 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:40.562415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-29497f9a-88d4-40f5-9c46-c03397e458b8 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:40.574075 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-29497f9a-88d4-40f5-9c46-c03397e458b8 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:40.575158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-29497f9a-88d4-40f5-9c46-c03397e458b8 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:40.576011 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-29497f9a-88d4-40f5-9c46-c03397e458b8 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:40.576458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-29497f9a-88d4-40f5-9c46-c03397e458b8 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:40.632550 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-29497f9a-88d4-40f5-9c46-c03397e458b8 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:53:40.732017 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-29497f9a-88d4-40f5-9c46-c03397e458b8 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 204 len: 0 microversion: 2.1 time: 0.173869 May 10 17:53:40.732559 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 431/874] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:53:40 2022] DELETE /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:53:40.740889 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-cfa4b224-7ee5-4396-9867-004b8fe271b5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:40.741527 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-cfa4b224-7ee5-4396-9867-004b8fe271b5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:40.751641 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cfa4b224-7ee5-4396-9867-004b8fe271b5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:40.752086 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cfa4b224-7ee5-4396-9867-004b8fe271b5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:40.752863 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cfa4b224-7ee5-4396-9867-004b8fe271b5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:40.753480 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cfa4b224-7ee5-4396-9867-004b8fe271b5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:40.909693 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-cfa4b224-7ee5-4396-9867-004b8fe271b5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:40.923758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-cfa4b224-7ee5-4396-9867-004b8fe271b5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 200 len: 1682 microversion: 2.1 time: 0.186425 May 10 17:53:40.924774 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 444/875] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:53:40 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:53:41.944573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-536b8024-fdbd-4556-8a68-f730c28ac099 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:41.945268 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-536b8024-fdbd-4556-8a68-f730c28ac099 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:41.951870 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-536b8024-fdbd-4556-8a68-f730c28ac099 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:41.952323 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-536b8024-fdbd-4556-8a68-f730c28ac099 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:41.953113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-536b8024-fdbd-4556-8a68-f730c28ac099 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:41.953550 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-536b8024-fdbd-4556-8a68-f730c28ac099 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:42.083948 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-536b8024-fdbd-4556-8a68-f730c28ac099 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:42.091509 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-536b8024-fdbd-4556-8a68-f730c28ac099 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 200 len: 1682 microversion: 2.1 time: 0.151220 May 10 17:53:42.092006 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 432/876] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:53:41 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:53:42.103946 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5867029d-9a23-4e43-ae98-a31019d63e0d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:42.104489 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5867029d-9a23-4e43-ae98-a31019d63e0d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:42.110954 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5867029d-9a23-4e43-ae98-a31019d63e0d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:42.111436 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5867029d-9a23-4e43-ae98-a31019d63e0d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:42.112216 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5867029d-9a23-4e43-ae98-a31019d63e0d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:42.112656 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5867029d-9a23-4e43-ae98-a31019d63e0d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:42.136431 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-5867029d-9a23-4e43-ae98-a31019d63e0d tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6/ips" status: 200 len: 151 microversion: 2.20 time: 0.037021 May 10 17:53:42.137010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 445/877] 10.222.0.60 () {60 vars in 1288 bytes} [Tue May 10 17:53:42 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:53:43.109396 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e8c1a434-0e37-4ba9-8ae2-aaa7aab4a94c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:43.110076 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e8c1a434-0e37-4ba9-8ae2-aaa7aab4a94c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:43.117663 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e8c1a434-0e37-4ba9-8ae2-aaa7aab4a94c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:43.118162 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e8c1a434-0e37-4ba9-8ae2-aaa7aab4a94c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:43.119076 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e8c1a434-0e37-4ba9-8ae2-aaa7aab4a94c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:43.119625 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e8c1a434-0e37-4ba9-8ae2-aaa7aab4a94c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:43.359488 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e8c1a434-0e37-4ba9-8ae2-aaa7aab4a94c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:43.369696 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e8c1a434-0e37-4ba9-8ae2-aaa7aab4a94c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 200 len: 1682 microversion: 2.1 time: 0.264215 May 10 17:53:43.370293 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 433/878] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:53:43 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 1682 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:53:43.930352 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-74e5662e-d5aa-4fcb-89af-e89c3f2b324f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:53:43.931068 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-74e5662e-d5aa-4fcb-89af-e89c3f2b324f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:43.935014 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-9f5623ec-0dd7-4355-9cef-e0a1eeca22f4 req-0f1713bc-1bdb-4978-8578-65e0d6bf95c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed2618f3-4f12-48c9-888c-814f93d1fc49", "name": "network-vif-deleted", "tag": "33f2c369-a8b0-48aa-b116-b1391feb5a44"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:53:43.941704 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-74e5662e-d5aa-4fcb-89af-e89c3f2b324f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:43.942947 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-74e5662e-d5aa-4fcb-89af-e89c3f2b324f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:43.944236 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-74e5662e-d5aa-4fcb-89af-e89c3f2b324f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:43.945187 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-74e5662e-d5aa-4fcb-89af-e89c3f2b324f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:43.954906 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-9f5623ec-0dd7-4355-9cef-e0a1eeca22f4 req-0f1713bc-1bdb-4978-8578-65e0d6bf95c1 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:43.955391 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-9f5623ec-0dd7-4355-9cef-e0a1eeca22f4 req-0f1713bc-1bdb-4978-8578-65e0d6bf95c1 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:43.969876 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-9f5623ec-0dd7-4355-9cef-e0a1eeca22f4 req-0f1713bc-1bdb-4978-8578-65e0d6bf95c1 service nova] Creating event network-vif-deleted:33f2c369-a8b0-48aa-b116-b1391feb5a44 for instance ed2618f3-4f12-48c9-888c-814f93d1fc49 on hv-cinder-84130 May 10 17:53:43.976699 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-9f5623ec-0dd7-4355-9cef-e0a1eeca22f4 req-0f1713bc-1bdb-4978-8578-65e0d6bf95c1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048620 May 10 17:53:43.977718 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 434/879] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:53:43.995246 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.objects.instance [None req-74e5662e-d5aa-4fcb-89af-e89c3f2b324f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lazy-loading 'flavor' on Instance uuid e16b7603-15a8-44a4-82c9-729bedfb8ac6 {{(pid=123753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:53:44.345422 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-74e5662e-d5aa-4fcb-89af-e89c3f2b324f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "POST /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6/action" status: 202 len: 0 microversion: 2.20 time: 0.420388 May 10 17:53:44.346415 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 446/880] 10.222.0.60 () {62 vars in 1318 bytes} [Tue May 10 17:53:43 2022] POST /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6/action => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 10 17:53:44.357577 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-74dc1a55-a80b-4012-9940-2913acb172f8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:44.358277 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-74dc1a55-a80b-4012-9940-2913acb172f8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:44.365887 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-74dc1a55-a80b-4012-9940-2913acb172f8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:44.366634 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-74dc1a55-a80b-4012-9940-2913acb172f8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:44.367543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-74dc1a55-a80b-4012-9940-2913acb172f8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:44.367987 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-74dc1a55-a80b-4012-9940-2913acb172f8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:44.387351 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-61417c74-29f6-4b04-824b-deb8fc04c258 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:44.388114 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-61417c74-29f6-4b04-824b-deb8fc04c258 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:44.395216 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-61417c74-29f6-4b04-824b-deb8fc04c258 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:44.395706 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-61417c74-29f6-4b04-824b-deb8fc04c258 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:44.397217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-61417c74-29f6-4b04-824b-deb8fc04c258 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:44.397670 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-61417c74-29f6-4b04-824b-deb8fc04c258 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:44.435165 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-61417c74-29f6-4b04-824b-deb8fc04c258 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:44.435661 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-61417c74-29f6-4b04-824b-deb8fc04c258 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:44.436132 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.objects.instance [None req-61417c74-29f6-4b04-824b-deb8fc04c258 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lazy-loading 'fault' on Instance uuid ed2618f3-4f12-48c9-888c-814f93d1fc49 {{(pid=123753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:53:44.498345 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-61417c74-29f6-4b04-824b-deb8fc04c258 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:44.516965 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-61417c74-29f6-4b04-824b-deb8fc04c258 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 200 len: 1331 microversion: 2.1 time: 0.134099 May 10 17:53:44.517574 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 447/881] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:53:44 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 1331 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:53:44.563679 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-74dc1a55-a80b-4012-9940-2913acb172f8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:44.572569 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-74dc1a55-a80b-4012-9940-2913acb172f8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:44.574249 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-74dc1a55-a80b-4012-9940-2913acb172f8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:44.575496 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-74dc1a55-a80b-4012-9940-2913acb172f8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1722 microversion: 2.20 time: 0.222690 May 10 17:53:44.576068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 435/882] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:53:44 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:53:45.536759 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-504a7dff-9e15-4301-bc01-bbb9fde5a81d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:45.538535 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-504a7dff-9e15-4301-bc01-bbb9fde5a81d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:45.545211 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-504a7dff-9e15-4301-bc01-bbb9fde5a81d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:45.545666 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-504a7dff-9e15-4301-bc01-bbb9fde5a81d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:45.546468 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-504a7dff-9e15-4301-bc01-bbb9fde5a81d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:45.546919 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-504a7dff-9e15-4301-bc01-bbb9fde5a81d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:45.562680 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-504a7dff-9e15-4301-bc01-bbb9fde5a81d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] HTTP exception thrown: Instance ed2618f3-4f12-48c9-888c-814f93d1fc49 could not be found. May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-504a7dff-9e15-4301-bc01-bbb9fde5a81d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Request method failure captured: May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 HTTP/1.1 May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqSO0xr7UIRxT3hXOmHxzovF69xIsGczVBDivdJOJBMJVORxiAfv56xQ3YabG87POPmQfFexgT58vToWwr1fhnRiMZA5-8wUr6OWagNr8GqdBYrkCpJLIa4vawh-qHLJ2BS3J-kASnH0YnEYJlsAV4sLiWMw7Cfpf3RSa_gKuZeEwB0 May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: f4e017a4040d450aad862065563ea64d May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:53:45.564390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:53:45.565831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4e017a4040d450aad862065563ea64d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4e017a4040d450aad862065563ea64d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}] May 10 17:53:45.565831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-AttachVolumeNegativeTest-101320951 May 10 17:53:45.565831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: f4e017a4040d450aad862065563ea64d May 10 17:53:45.565831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:53:45.565831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:53:45.565831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:53:45.565831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:53:45.565831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: e6a99e5d684a48a2845d3379e7df812c May 10 17:53:45.565831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:53:45.565831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:53:45.565831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance ed2618f3-4f12-48c9-888c-814f93d1fc49 could not be found. May 10 17:53:45.565831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': 'ed2618f3-4f12-48c9-888c-814f93d1fc49'} May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed2618f3-4f12-48c9-888c-814f93d1fc49 could not be found. May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:53:45.566684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:53:45.568295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:53:45.568295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:53:45.568295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:53:45.568295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:53:45.568295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:53:45.568295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:53:45.568295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:53:45.568295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed2618f3-4f12-48c9-888c-814f93d1fc49 could not be found. May 10 17:53:45.568295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:53:45.568295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:53:45.568295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:53:45.568295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:53:45.568295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:53:45.568295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:53:45.568295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:53:45.568295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:53:45.568295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed2618f3-4f12-48c9-888c-814f93d1fc49 could not be found. May 10 17:53:45.568295 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:53:45.572760 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-504a7dff-9e15-4301-bc01-bbb9fde5a81d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Returning 404 to user: Instance ed2618f3-4f12-48c9-888c-814f93d1fc49 could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:53:45.572760 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-504a7dff-9e15-4301-bc01-bbb9fde5a81d tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 404 len: 111 microversion: 2.1 time: 0.033372 May 10 17:53:45.572760 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 448/883] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:53:45 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:53:45.576160 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cc844cce-9b92-4cc9-b385-348dabbfb50c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '.version_select at 0x7f3e769b29d0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:45.594804 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-6942c7d9-fccc-4e4f-9ce9-6ecd82a39f3e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:45.595565 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-6942c7d9-fccc-4e4f-9ce9-6ecd82a39f3e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:45.595836 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cc844cce-9b92-4cc9-b385-348dabbfb50c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1051743302" status: 202 len: 0 microversion: 2.1 time: 0.023801 May 10 17:53:45.596132 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 436/884] 10.222.0.60 () {58 vars in 1220 bytes} [Tue May 10 17:53:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1051743302 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 17:53:45.603269 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6942c7d9-fccc-4e4f-9ce9-6ecd82a39f3e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:45.603779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6942c7d9-fccc-4e4f-9ce9-6ecd82a39f3e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:45.604588 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6942c7d9-fccc-4e4f-9ce9-6ecd82a39f3e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:45.605035 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6942c7d9-fccc-4e4f-9ce9-6ecd82a39f3e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:45.828592 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6942c7d9-fccc-4e4f-9ce9-6ecd82a39f3e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:45.839267 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6942c7d9-fccc-4e4f-9ce9-6ecd82a39f3e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:45.841595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6942c7d9-fccc-4e4f-9ce9-6ecd82a39f3e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:45.842805 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-6942c7d9-fccc-4e4f-9ce9-6ecd82a39f3e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1722 microversion: 2.20 time: 0.252220 May 10 17:53:45.843755 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 449/885] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:53:45 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:53:46.404071 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9d27c046-a087-403a-9e9c-7fbd7b404c8a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Action: 'create', calling method: .version_select at 0x7f3e768e1700>, body: {"keypair": {"name": "tempest-keypair-442766912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJPOuyOggViFgQwV5vuHyOyY9OpeGuBaP71airkXexLocT2E2Rz+79/vXDul/4uRmqynvujZcqFyqv0eBnxXKy3svHWANuKQzsQBLZUoWapi//pewmoj2qJEIW4loskjDQ=="}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:53:46.420555 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-9d27c046-a087-403a-9e9c-7fbd7b404c8a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Getting quotas for project f4e017a4040d450aad862065563ea64d. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:53:46.424763 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-9d27c046-a087-403a-9e9c-7fbd7b404c8a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Getting quotas for user e6a99e5d684a48a2845d3379e7df812c and project f4e017a4040d450aad862065563ea64d. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:53:46.449953 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9d27c046-a087-403a-9e9c-7fbd7b404c8a tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049793 May 10 17:53:46.450565 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 437/886] 10.222.0.60 () {60 vars in 1158 bytes} [Tue May 10 17:53:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:53:46.862254 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c2a48fa5-443d-4040-8b77-d71e071441e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:46.862867 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c2a48fa5-443d-4040-8b77-d71e071441e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:46.870028 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c2a48fa5-443d-4040-8b77-d71e071441e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:46.870489 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c2a48fa5-443d-4040-8b77-d71e071441e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:46.871265 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c2a48fa5-443d-4040-8b77-d71e071441e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:46.871729 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c2a48fa5-443d-4040-8b77-d71e071441e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:47.017277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c2a48fa5-443d-4040-8b77-d71e071441e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:47.025775 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c2a48fa5-443d-4040-8b77-d71e071441e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:47.027270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c2a48fa5-443d-4040-8b77-d71e071441e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:47.028491 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c2a48fa5-443d-4040-8b77-d71e071441e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1722 microversion: 2.20 time: 0.170271 May 10 17:53:47.029037 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 450/887] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:53:46 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:53:48.046670 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4d3e9fa5-0556-4110-9237-822fb2785643 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:48.047341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4d3e9fa5-0556-4110-9237-822fb2785643 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:48.054200 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4d3e9fa5-0556-4110-9237-822fb2785643 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:48.054659 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4d3e9fa5-0556-4110-9237-822fb2785643 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:48.055485 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4d3e9fa5-0556-4110-9237-822fb2785643 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:48.055928 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4d3e9fa5-0556-4110-9237-822fb2785643 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:48.083920 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5deae7ab-35f5-4525-b588-819b75148528 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-125543754", "imageRef": "a7737c62-8029-44aa-8da7-e46fea7607fb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a13d84d-c9e9-413f-a254-ca6edab95c78"}], "security_groups": [{"name": "tempest-securitygroup--1916819909"}], "key_name": "tempest-keypair-442766912", "user_data": "}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:53:48.228471 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.network.neutron [None req-5deae7ab-35f5-4525-b588-819b75148528 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] validate_networks() for [('5a13d84d-c9e9-413f-a254-ca6edab95c78', None, None, None, None, None)] {{(pid=123753) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:53:48.233091 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4d3e9fa5-0556-4110-9237-822fb2785643 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:48.241471 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4d3e9fa5-0556-4110-9237-822fb2785643 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:48.243129 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-4d3e9fa5-0556-4110-9237-822fb2785643 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:48.244345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4d3e9fa5-0556-4110-9237-822fb2785643 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1722 microversion: 2.20 time: 0.202177 May 10 17:53:48.244920 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 438/888] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:53:48 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:53:48.602872 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-5deae7ab-35f5-4525-b588-819b75148528 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Flavor limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:53:48.603293 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-5deae7ab-35f5-4525-b588-819b75148528 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Image limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:53:48.603797 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-5deae7ab-35f5-4525-b588-819b75148528 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Flavor pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:53:48.604218 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-5deae7ab-35f5-4525-b588-819b75148528 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Image pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:53:48.604654 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-5deae7ab-35f5-4525-b588-819b75148528 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:53:48.619786 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5deae7ab-35f5-4525-b588-819b75148528 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:48.620197 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5deae7ab-35f5-4525-b588-819b75148528 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:48.620972 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5deae7ab-35f5-4525-b588-819b75148528 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:48.621414 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5deae7ab-35f5-4525-b588-819b75148528 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:48.639076 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-5deae7ab-35f5-4525-b588-819b75148528 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Getting quotas for project f4e017a4040d450aad862065563ea64d. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:53:48.643146 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-5deae7ab-35f5-4525-b588-819b75148528 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Getting quotas for user e6a99e5d684a48a2845d3379e7df812c and project f4e017a4040d450aad862065563ea64d. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:53:48.655460 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5deae7ab-35f5-4525-b588-819b75148528 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Going to run 1 instances... {{(pid=123753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:53:48.657780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5deae7ab-35f5-4525-b588-819b75148528 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7737c62-8029-44aa-8da7-e46fea7607fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:53:48.706257 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-5deae7ab-35f5-4525-b588-819b75148528 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.627093 May 10 17:53:48.706918 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 451/889] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 17:53:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 17:53:48.721261 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3f075700-5b23-4047-810c-8cb1e23ebbc9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:48.721886 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3f075700-5b23-4047-810c-8cb1e23ebbc9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:48.796108 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3f075700-5b23-4047-810c-8cb1e23ebbc9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:48.807871 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3f075700-5b23-4047-810c-8cb1e23ebbc9 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 200 len: 1240 microversion: 2.1 time: 0.093562 May 10 17:53:48.808627 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 439/890] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:53:48 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 1240 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:53:49.265901 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fb1b125e-be02-4880-9ed9-8f8023c455cb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:49.266746 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-fb1b125e-be02-4880-9ed9-8f8023c455cb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:49.274075 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fb1b125e-be02-4880-9ed9-8f8023c455cb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:49.274525 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fb1b125e-be02-4880-9ed9-8f8023c455cb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:49.275322 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fb1b125e-be02-4880-9ed9-8f8023c455cb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:49.275803 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fb1b125e-be02-4880-9ed9-8f8023c455cb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:49.434204 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fb1b125e-be02-4880-9ed9-8f8023c455cb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:49.442203 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fb1b125e-be02-4880-9ed9-8f8023c455cb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:49.443907 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fb1b125e-be02-4880-9ed9-8f8023c455cb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:49.445086 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-fb1b125e-be02-4880-9ed9-8f8023c455cb tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1722 microversion: 2.20 time: 0.185332 May 10 17:53:49.445640 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 452/891] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:53:49 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:53:49.834692 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-98cda214-5c88-434f-8709-0c65e676337c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:49.835622 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-98cda214-5c88-434f-8709-0c65e676337c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:49.845353 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98cda214-5c88-434f-8709-0c65e676337c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:49.845814 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98cda214-5c88-434f-8709-0c65e676337c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:49.846610 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98cda214-5c88-434f-8709-0c65e676337c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:49.847055 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98cda214-5c88-434f-8709-0c65e676337c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:49.933919 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-98cda214-5c88-434f-8709-0c65e676337c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:49.942528 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-98cda214-5c88-434f-8709-0c65e676337c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 200 len: 1310 microversion: 2.1 time: 0.112349 May 10 17:53:49.947732 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 440/892] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:53:49 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 1310 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:53:50.463720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1f59a062-673d-4c7c-96a9-9c69023a3bd8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:50.464276 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-1f59a062-673d-4c7c-96a9-9c69023a3bd8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:50.470153 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1f59a062-673d-4c7c-96a9-9c69023a3bd8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:50.470611 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1f59a062-673d-4c7c-96a9-9c69023a3bd8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:50.471422 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1f59a062-673d-4c7c-96a9-9c69023a3bd8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:50.471865 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1f59a062-673d-4c7c-96a9-9c69023a3bd8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:50.674582 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1f59a062-673d-4c7c-96a9-9c69023a3bd8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:50.684567 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1f59a062-673d-4c7c-96a9-9c69023a3bd8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:50.686055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1f59a062-673d-4c7c-96a9-9c69023a3bd8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:50.687305 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-1f59a062-673d-4c7c-96a9-9c69023a3bd8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1722 microversion: 2.20 time: 0.228240 May 10 17:53:50.687977 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 453/893] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:53:50 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:53:50.960343 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-003d72a7-5719-4a1e-b2ff-4e20f9eb9f62 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:50.961130 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-003d72a7-5719-4a1e-b2ff-4e20f9eb9f62 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:50.967557 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-003d72a7-5719-4a1e-b2ff-4e20f9eb9f62 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:50.968023 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-003d72a7-5719-4a1e-b2ff-4e20f9eb9f62 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:50.968834 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-003d72a7-5719-4a1e-b2ff-4e20f9eb9f62 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:50.969276 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-003d72a7-5719-4a1e-b2ff-4e20f9eb9f62 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:51.182513 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-003d72a7-5719-4a1e-b2ff-4e20f9eb9f62 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:51.189846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-003d72a7-5719-4a1e-b2ff-4e20f9eb9f62 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 200 len: 1366 microversion: 2.1 time: 0.234038 May 10 17:53:51.190415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 441/894] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:53:50 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:53:51.536091 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-f55ead31-415c-49de-80ed-ba3e4bd9431b req-58e036c3-7ae8-4205-b965-33deb714980d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b20de23a-a487-4289-9b7f-e82881619086", "tag": "d03a940c-796d-4bb9-afaa-60957357f90f"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:53:51.555774 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-f55ead31-415c-49de-80ed-ba3e4bd9431b req-58e036c3-7ae8-4205-b965-33deb714980d service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:51.557004 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-f55ead31-415c-49de-80ed-ba3e4bd9431b req-58e036c3-7ae8-4205-b965-33deb714980d service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:51.577618 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-f55ead31-415c-49de-80ed-ba3e4bd9431b req-58e036c3-7ae8-4205-b965-33deb714980d service nova] Creating event network-changed:d03a940c-796d-4bb9-afaa-60957357f90f for instance b20de23a-a487-4289-9b7f-e82881619086 on hv-cinder-84130 May 10 17:53:51.583324 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-f55ead31-415c-49de-80ed-ba3e4bd9431b req-58e036c3-7ae8-4205-b965-33deb714980d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053509 May 10 17:53:51.584401 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 454/895] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:53:51.710675 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8e795cd8-30a0-4e48-b10a-c18ba5320d09 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:51.711664 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8e795cd8-30a0-4e48-b10a-c18ba5320d09 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:51.718788 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8e795cd8-30a0-4e48-b10a-c18ba5320d09 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:51.719247 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8e795cd8-30a0-4e48-b10a-c18ba5320d09 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:51.720099 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8e795cd8-30a0-4e48-b10a-c18ba5320d09 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:51.720634 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8e795cd8-30a0-4e48-b10a-c18ba5320d09 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:51.963834 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8e795cd8-30a0-4e48-b10a-c18ba5320d09 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:51.973325 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8e795cd8-30a0-4e48-b10a-c18ba5320d09 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:51.975494 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8e795cd8-30a0-4e48-b10a-c18ba5320d09 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:51.976817 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8e795cd8-30a0-4e48-b10a-c18ba5320d09 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1722 microversion: 2.20 time: 0.272459 May 10 17:53:51.977426 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 442/896] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:53:51 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:53:52.209346 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2949d030-4465-4e46-91d1-af0efaefb331 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:52.210102 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-2949d030-4465-4e46-91d1-af0efaefb331 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:52.217115 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2949d030-4465-4e46-91d1-af0efaefb331 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:52.217745 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2949d030-4465-4e46-91d1-af0efaefb331 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:52.218276 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2949d030-4465-4e46-91d1-af0efaefb331 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:52.218842 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2949d030-4465-4e46-91d1-af0efaefb331 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:52.367264 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-2949d030-4465-4e46-91d1-af0efaefb331 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:52.375034 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-2949d030-4465-4e46-91d1-af0efaefb331 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 200 len: 1366 microversion: 2.1 time: 0.170661 May 10 17:53:52.375647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 455/897] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:53:52 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:53:52.998268 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-01d70095-ea0a-4005-afeb-a749efd637d1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:52.998268 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-01d70095-ea0a-4005-afeb-a749efd637d1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:53.005043 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-01d70095-ea0a-4005-afeb-a749efd637d1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:53.005519 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-01d70095-ea0a-4005-afeb-a749efd637d1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:53.007084 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-01d70095-ea0a-4005-afeb-a749efd637d1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:53.007563 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-01d70095-ea0a-4005-afeb-a749efd637d1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:53.153789 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-01d70095-ea0a-4005-afeb-a749efd637d1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:53.163100 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-01d70095-ea0a-4005-afeb-a749efd637d1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:53.164796 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-01d70095-ea0a-4005-afeb-a749efd637d1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:53.166117 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-01d70095-ea0a-4005-afeb-a749efd637d1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1722 microversion: 2.20 time: 0.173374 May 10 17:53:53.167198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 443/898] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:53:52 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:53:53.392764 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-72f57e1b-6854-4d67-b789-81357d195e8f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:53.393372 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-72f57e1b-6854-4d67-b789-81357d195e8f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:53.401313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-72f57e1b-6854-4d67-b789-81357d195e8f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:53.401778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-72f57e1b-6854-4d67-b789-81357d195e8f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:53.402579 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-72f57e1b-6854-4d67-b789-81357d195e8f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:53.403028 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-72f57e1b-6854-4d67-b789-81357d195e8f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:53.558950 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-72f57e1b-6854-4d67-b789-81357d195e8f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:53.573866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-72f57e1b-6854-4d67-b789-81357d195e8f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 200 len: 1366 microversion: 2.1 time: 0.184699 May 10 17:53:53.574564 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 456/899] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:53:53 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:53:54.185271 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-436c70d1-e11c-44e4-945b-71903c9a37a8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:54.186010 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-436c70d1-e11c-44e4-945b-71903c9a37a8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:54.193960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-436c70d1-e11c-44e4-945b-71903c9a37a8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:54.194811 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-436c70d1-e11c-44e4-945b-71903c9a37a8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:54.195838 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-436c70d1-e11c-44e4-945b-71903c9a37a8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:54.196297 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-436c70d1-e11c-44e4-945b-71903c9a37a8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:54.361851 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-436c70d1-e11c-44e4-945b-71903c9a37a8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:54.371389 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-436c70d1-e11c-44e4-945b-71903c9a37a8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:54.372928 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-436c70d1-e11c-44e4-945b-71903c9a37a8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:54.374139 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-436c70d1-e11c-44e4-945b-71903c9a37a8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1722 microversion: 2.20 time: 0.192946 May 10 17:53:54.374714 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 444/900] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:53:54 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:53:54.590384 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a6c87d68-bd1e-4930-bd07-772121d0625f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:54.591000 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a6c87d68-bd1e-4930-bd07-772121d0625f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:54.598250 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a6c87d68-bd1e-4930-bd07-772121d0625f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:54.598712 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a6c87d68-bd1e-4930-bd07-772121d0625f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:54.600328 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a6c87d68-bd1e-4930-bd07-772121d0625f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:54.600843 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a6c87d68-bd1e-4930-bd07-772121d0625f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:54.810668 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a6c87d68-bd1e-4930-bd07-772121d0625f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:54.821866 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a6c87d68-bd1e-4930-bd07-772121d0625f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 200 len: 1366 microversion: 2.1 time: 0.235391 May 10 17:53:54.822532 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 457/901] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:53:54 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:53:55.398547 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-77d49fd1-fbf4-463b-94b4-f5e59826c6d7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:55.399687 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-77d49fd1-fbf4-463b-94b4-f5e59826c6d7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:55.411696 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-77d49fd1-fbf4-463b-94b4-f5e59826c6d7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:55.412501 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-77d49fd1-fbf4-463b-94b4-f5e59826c6d7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:55.414032 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-77d49fd1-fbf4-463b-94b4-f5e59826c6d7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:55.415178 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-77d49fd1-fbf4-463b-94b4-f5e59826c6d7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:55.684608 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-77d49fd1-fbf4-463b-94b4-f5e59826c6d7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:55.695460 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-77d49fd1-fbf4-463b-94b4-f5e59826c6d7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:55.697131 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-77d49fd1-fbf4-463b-94b4-f5e59826c6d7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:55.698764 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-77d49fd1-fbf4-463b-94b4-f5e59826c6d7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1722 microversion: 2.20 time: 0.307223 May 10 17:53:55.699355 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 445/902] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:53:55 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:53:55.841138 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-744e3e3e-c271-48b0-b5b8-c27ff8252e32 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:55.841138 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-744e3e3e-c271-48b0-b5b8-c27ff8252e32 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:55.848106 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-744e3e3e-c271-48b0-b5b8-c27ff8252e32 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:55.848634 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-744e3e3e-c271-48b0-b5b8-c27ff8252e32 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:55.850144 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-744e3e3e-c271-48b0-b5b8-c27ff8252e32 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:55.850628 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-744e3e3e-c271-48b0-b5b8-c27ff8252e32 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:56.016473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-744e3e3e-c271-48b0-b5b8-c27ff8252e32 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:56.028496 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-744e3e3e-c271-48b0-b5b8-c27ff8252e32 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 200 len: 1366 microversion: 2.1 time: 0.191808 May 10 17:53:56.029504 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 458/903] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:53:55 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:53:56.726999 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-37125eea-3388-4408-bbf1-1e75cc7ca1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:56.727572 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-37125eea-3388-4408-bbf1-1e75cc7ca1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:56.735405 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-37125eea-3388-4408-bbf1-1e75cc7ca1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:56.735844 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-37125eea-3388-4408-bbf1-1e75cc7ca1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:56.737076 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-37125eea-3388-4408-bbf1-1e75cc7ca1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:56.737521 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-37125eea-3388-4408-bbf1-1e75cc7ca1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:56.915781 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-37125eea-3388-4408-bbf1-1e75cc7ca1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:56.925175 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-37125eea-3388-4408-bbf1-1e75cc7ca1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:56.926891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-37125eea-3388-4408-bbf1-1e75cc7ca1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:56.928588 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-37125eea-3388-4408-bbf1-1e75cc7ca1a1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1743 microversion: 2.20 time: 0.206441 May 10 17:53:56.929238 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 446/904] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:53:56 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1743 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:53:57.050604 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a1b1799c-ebd9-4c53-a41f-ba431f773fec tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:57.051202 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a1b1799c-ebd9-4c53-a41f-ba431f773fec tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:57.059247 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a1b1799c-ebd9-4c53-a41f-ba431f773fec tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:57.059823 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a1b1799c-ebd9-4c53-a41f-ba431f773fec tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:57.060646 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a1b1799c-ebd9-4c53-a41f-ba431f773fec tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:57.061131 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a1b1799c-ebd9-4c53-a41f-ba431f773fec tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:57.232937 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a1b1799c-ebd9-4c53-a41f-ba431f773fec tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:57.242678 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a1b1799c-ebd9-4c53-a41f-ba431f773fec tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 200 len: 1366 microversion: 2.1 time: 0.195999 May 10 17:53:57.243277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 459/905] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:53:57 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:53:57.949286 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-34133f8f-5c29-413a-89f8-48a3d76b3e83 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:57.950486 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-34133f8f-5c29-413a-89f8-48a3d76b3e83 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:57.959055 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34133f8f-5c29-413a-89f8-48a3d76b3e83 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:57.959774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34133f8f-5c29-413a-89f8-48a3d76b3e83 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:57.960761 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34133f8f-5c29-413a-89f8-48a3d76b3e83 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:57.961347 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-34133f8f-5c29-413a-89f8-48a3d76b3e83 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:58.119011 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-f2bfc61a-0b2a-4ca3-863f-ea8da62c0326 req-4813e1a4-5869-4758-ae58-8dca220f5ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b20de23a-a487-4289-9b7f-e82881619086", "name": "network-vif-plugged", "status": "completed", "tag": "d03a940c-796d-4bb9-afaa-60957357f90f"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:53:58.135706 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-f2bfc61a-0b2a-4ca3-863f-ea8da62c0326 req-4813e1a4-5869-4758-ae58-8dca220f5ddb service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:58.141225 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-34133f8f-5c29-413a-89f8-48a3d76b3e83 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:58.148246 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-f2bfc61a-0b2a-4ca3-863f-ea8da62c0326 req-4813e1a4-5869-4758-ae58-8dca220f5ddb service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:58.155802 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-34133f8f-5c29-413a-89f8-48a3d76b3e83 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:58.159555 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-34133f8f-5c29-413a-89f8-48a3d76b3e83 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:58.161503 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-34133f8f-5c29-413a-89f8-48a3d76b3e83 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1743 microversion: 2.20 time: 0.216465 May 10 17:53:58.171512 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-f2bfc61a-0b2a-4ca3-863f-ea8da62c0326 req-4813e1a4-5869-4758-ae58-8dca220f5ddb service nova] Creating event network-vif-plugged:d03a940c-796d-4bb9-afaa-60957357f90f for instance b20de23a-a487-4289-9b7f-e82881619086 on hv-cinder-84130 May 10 17:53:58.175053 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 447/906] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:53:57 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1743 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:53:58.181763 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-f2bfc61a-0b2a-4ca3-863f-ea8da62c0326 req-4813e1a4-5869-4758-ae58-8dca220f5ddb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071772 May 10 17:53:58.183410 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 460/907] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:53:58.263389 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6d6b6925-9293-4535-bf8b-1d5730a4228e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:58.264446 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6d6b6925-9293-4535-bf8b-1d5730a4228e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:58.275212 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6d6b6925-9293-4535-bf8b-1d5730a4228e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:58.276009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6d6b6925-9293-4535-bf8b-1d5730a4228e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:58.277406 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6d6b6925-9293-4535-bf8b-1d5730a4228e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:58.278073 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6d6b6925-9293-4535-bf8b-1d5730a4228e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:58.516359 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6d6b6925-9293-4535-bf8b-1d5730a4228e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:58.526223 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6d6b6925-9293-4535-bf8b-1d5730a4228e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 200 len: 1366 microversion: 2.1 time: 0.270321 May 10 17:53:58.526830 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 448/908] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:53:58 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:53:59.187716 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-d4da19ff-272e-47ba-bd37-ea2151560e1a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:59.188496 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-d4da19ff-272e-47ba-bd37-ea2151560e1a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:59.197510 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d4da19ff-272e-47ba-bd37-ea2151560e1a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:59.198317 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d4da19ff-272e-47ba-bd37-ea2151560e1a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:59.200018 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d4da19ff-272e-47ba-bd37-ea2151560e1a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:59.200780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d4da19ff-272e-47ba-bd37-ea2151560e1a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:59.369233 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-d4da19ff-272e-47ba-bd37-ea2151560e1a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:59.378053 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-d4da19ff-272e-47ba-bd37-ea2151560e1a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:59.379663 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-d4da19ff-272e-47ba-bd37-ea2151560e1a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:59.381167 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-d4da19ff-272e-47ba-bd37-ea2151560e1a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1743 microversion: 2.20 time: 0.201049 May 10 17:53:59.382012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 461/909] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:53:59 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:53:59.547326 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-368c0b0c-3023-4c74-b188-ea37bb6693c0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:53:59.548074 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-368c0b0c-3023-4c74-b188-ea37bb6693c0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:53:59.556697 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-368c0b0c-3023-4c74-b188-ea37bb6693c0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:59.557202 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-368c0b0c-3023-4c74-b188-ea37bb6693c0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:59.558168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-368c0b0c-3023-4c74-b188-ea37bb6693c0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:53:59.558662 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-368c0b0c-3023-4c74-b188-ea37bb6693c0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:53:59.720710 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-368c0b0c-3023-4c74-b188-ea37bb6693c0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:53:59.729954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-368c0b0c-3023-4c74-b188-ea37bb6693c0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 200 len: 1366 microversion: 2.1 time: 0.187177 May 10 17:53:59.730553 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 449/910] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:53:59 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 1366 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:00.199396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-5ea917f6-1259-43c9-9482-85f8b7612152 req-5f29e497-29e4-4b1c-941e-ed1f7f6c613e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e16b7603-15a8-44a4-82c9-729bedfb8ac6", "name": "network-vif-plugged", "status": "completed", "tag": "cb176284-f148-403c-b988-83b0bfbdd7dd"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:54:00.209839 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-5ea917f6-1259-43c9-9482-85f8b7612152 req-5f29e497-29e4-4b1c-941e-ed1f7f6c613e service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:00.210283 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-5ea917f6-1259-43c9-9482-85f8b7612152 req-5f29e497-29e4-4b1c-941e-ed1f7f6c613e service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:00.229827 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-5ea917f6-1259-43c9-9482-85f8b7612152 req-5f29e497-29e4-4b1c-941e-ed1f7f6c613e service nova] Creating event network-vif-plugged:cb176284-f148-403c-b988-83b0bfbdd7dd for instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 on hv-cinder-84130 May 10 17:54:00.239578 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-5ea917f6-1259-43c9-9482-85f8b7612152 req-5f29e497-29e4-4b1c-941e-ed1f7f6c613e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045183 May 10 17:54:00.240497 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 462/911] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:54:00.401243 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b654df00-d4ad-44dc-86c0-84019ae8296f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:00.401868 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b654df00-d4ad-44dc-86c0-84019ae8296f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:00.409769 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b654df00-d4ad-44dc-86c0-84019ae8296f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:00.410420 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b654df00-d4ad-44dc-86c0-84019ae8296f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:00.411427 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b654df00-d4ad-44dc-86c0-84019ae8296f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:00.412684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b654df00-d4ad-44dc-86c0-84019ae8296f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:00.593058 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b654df00-d4ad-44dc-86c0-84019ae8296f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:00.604162 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b654df00-d4ad-44dc-86c0-84019ae8296f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:00.606620 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b654df00-d4ad-44dc-86c0-84019ae8296f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:00.608345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b654df00-d4ad-44dc-86c0-84019ae8296f tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1743 microversion: 2.20 time: 0.211287 May 10 17:54:00.609147 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 450/912] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:00 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1743 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:00.755043 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-79415abd-8d1e-42cf-8459-bb4d8205079b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:00.756742 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-79415abd-8d1e-42cf-8459-bb4d8205079b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:00.766089 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-79415abd-8d1e-42cf-8459-bb4d8205079b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:00.766566 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-79415abd-8d1e-42cf-8459-bb4d8205079b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:00.767752 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-79415abd-8d1e-42cf-8459-bb4d8205079b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:00.768250 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-79415abd-8d1e-42cf-8459-bb4d8205079b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:00.945015 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-79415abd-8d1e-42cf-8459-bb4d8205079b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:00.953780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-79415abd-8d1e-42cf-8459-bb4d8205079b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 200 len: 1366 microversion: 2.1 time: 0.203186 May 10 17:54:00.954388 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 463/913] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:00 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:01.635038 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1c5b83ff-45b3-4c12-a64d-7bd80a46345a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:01.635974 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-1c5b83ff-45b3-4c12-a64d-7bd80a46345a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:01.644119 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1c5b83ff-45b3-4c12-a64d-7bd80a46345a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:01.644752 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1c5b83ff-45b3-4c12-a64d-7bd80a46345a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:01.646826 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1c5b83ff-45b3-4c12-a64d-7bd80a46345a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:01.647589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-1c5b83ff-45b3-4c12-a64d-7bd80a46345a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:01.803571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1c5b83ff-45b3-4c12-a64d-7bd80a46345a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:01.812427 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1c5b83ff-45b3-4c12-a64d-7bd80a46345a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:01.814006 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-1c5b83ff-45b3-4c12-a64d-7bd80a46345a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:01.815620 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1c5b83ff-45b3-4c12-a64d-7bd80a46345a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1743 microversion: 2.20 time: 0.185267 May 10 17:54:01.816204 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 451/914] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:01 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1743 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:54:01.971667 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9c4816e9-0f16-4a84-924a-53c4b29c0746 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:01.972387 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-9c4816e9-0f16-4a84-924a-53c4b29c0746 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:01.980332 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9c4816e9-0f16-4a84-924a-53c4b29c0746 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:01.980793 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9c4816e9-0f16-4a84-924a-53c4b29c0746 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:01.981599 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9c4816e9-0f16-4a84-924a-53c4b29c0746 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:01.982053 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9c4816e9-0f16-4a84-924a-53c4b29c0746 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:02.140502 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-9c4816e9-0f16-4a84-924a-53c4b29c0746 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:02.149468 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-9c4816e9-0f16-4a84-924a-53c4b29c0746 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 200 len: 1556 microversion: 2.1 time: 0.182289 May 10 17:54:02.150073 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 464/915] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:01 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 1556 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:54:02.178724 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5a0a524e-4d50-466f-81da-0edea2ff3e66 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:02.179734 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5a0a524e-4d50-466f-81da-0edea2ff3e66 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:02.190621 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a0a524e-4d50-466f-81da-0edea2ff3e66 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:02.191308 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a0a524e-4d50-466f-81da-0edea2ff3e66 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:02.193326 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a0a524e-4d50-466f-81da-0edea2ff3e66 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:02.194221 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5a0a524e-4d50-466f-81da-0edea2ff3e66 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:02.286008 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5a0a524e-4d50-466f-81da-0edea2ff3e66 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114577 May 10 17:54:02.286900 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 452/916] 10.222.0.60 () {58 vars in 1274 bytes} [Tue May 10 17:54:02 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:54:02.841542 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-beabe229-43b9-4f07-85a5-29daf4e710e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:02.842385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-beabe229-43b9-4f07-85a5-29daf4e710e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:02.849679 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-beabe229-43b9-4f07-85a5-29daf4e710e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:02.850379 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-beabe229-43b9-4f07-85a5-29daf4e710e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:02.851434 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-beabe229-43b9-4f07-85a5-29daf4e710e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:02.851890 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-beabe229-43b9-4f07-85a5-29daf4e710e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:03.041434 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-beabe229-43b9-4f07-85a5-29daf4e710e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:03.057222 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-beabe229-43b9-4f07-85a5-29daf4e710e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:03.060156 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-beabe229-43b9-4f07-85a5-29daf4e710e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:03.062249 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-beabe229-43b9-4f07-85a5-29daf4e710e8 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1743 microversion: 2.20 time: 0.230872 May 10 17:54:03.063473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 465/917] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:02 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1743 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:03.539461 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-7bc95667-4fbb-491a-af9d-94e1e84ab180 req-c9a2a3f9-d41b-4cb1-aa35-49b8f61facdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b20de23a-a487-4289-9b7f-e82881619086", "tag": "d03a940c-796d-4bb9-afaa-60957357f90f"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:54:03.560649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-7bc95667-4fbb-491a-af9d-94e1e84ab180 req-c9a2a3f9-d41b-4cb1-aa35-49b8f61facdb service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:03.561178 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-7bc95667-4fbb-491a-af9d-94e1e84ab180 req-c9a2a3f9-d41b-4cb1-aa35-49b8f61facdb service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:03.579236 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-7bc95667-4fbb-491a-af9d-94e1e84ab180 req-c9a2a3f9-d41b-4cb1-aa35-49b8f61facdb service nova] Creating event network-changed:d03a940c-796d-4bb9-afaa-60957357f90f for instance b20de23a-a487-4289-9b7f-e82881619086 on hv-cinder-84130 May 10 17:54:03.586600 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-7bc95667-4fbb-491a-af9d-94e1e84ab180 req-c9a2a3f9-d41b-4cb1-aa35-49b8f61facdb service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052395 May 10 17:54:03.587208 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 453/918] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:54:04.101869 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-50e0a4de-88dc-4eb2-8fcb-42352c149896 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:04.103252 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-50e0a4de-88dc-4eb2-8fcb-42352c149896 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:04.115921 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-50e0a4de-88dc-4eb2-8fcb-42352c149896 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:04.116902 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-50e0a4de-88dc-4eb2-8fcb-42352c149896 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:04.118541 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-50e0a4de-88dc-4eb2-8fcb-42352c149896 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:04.119522 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-50e0a4de-88dc-4eb2-8fcb-42352c149896 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:04.475742 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-50e0a4de-88dc-4eb2-8fcb-42352c149896 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:04.505243 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-50e0a4de-88dc-4eb2-8fcb-42352c149896 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:04.514471 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-50e0a4de-88dc-4eb2-8fcb-42352c149896 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:04.517344 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-50e0a4de-88dc-4eb2-8fcb-42352c149896 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1738 microversion: 2.20 time: 0.426200 May 10 17:54:04.519251 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 466/919] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:04 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1738 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:05.545063 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-08f6a341-8f1d-4089-b80b-422a32dafd3b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:05.547917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-08f6a341-8f1d-4089-b80b-422a32dafd3b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:05.563245 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-08f6a341-8f1d-4089-b80b-422a32dafd3b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:05.564470 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-08f6a341-8f1d-4089-b80b-422a32dafd3b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:05.566313 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-08f6a341-8f1d-4089-b80b-422a32dafd3b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:05.567112 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-08f6a341-8f1d-4089-b80b-422a32dafd3b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:05.808450 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-08f6a341-8f1d-4089-b80b-422a32dafd3b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:05.845521 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-08f6a341-8f1d-4089-b80b-422a32dafd3b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:05.848015 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-08f6a341-8f1d-4089-b80b-422a32dafd3b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:05.850316 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-08f6a341-8f1d-4089-b80b-422a32dafd3b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1738 microversion: 2.20 time: 0.315652 May 10 17:54:05.851832 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 454/920] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:05 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1738 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:06.876193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f35ccc40-6e74-4601-83de-6c1ab399ad61 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:06.876856 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f35ccc40-6e74-4601-83de-6c1ab399ad61 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:06.887102 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f35ccc40-6e74-4601-83de-6c1ab399ad61 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:06.887591 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f35ccc40-6e74-4601-83de-6c1ab399ad61 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:06.888630 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f35ccc40-6e74-4601-83de-6c1ab399ad61 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:06.889080 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f35ccc40-6e74-4601-83de-6c1ab399ad61 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:07.089819 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f35ccc40-6e74-4601-83de-6c1ab399ad61 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:07.106961 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f35ccc40-6e74-4601-83de-6c1ab399ad61 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:07.109916 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f35ccc40-6e74-4601-83de-6c1ab399ad61 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:07.112467 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f35ccc40-6e74-4601-83de-6c1ab399ad61 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1738 microversion: 2.20 time: 0.240704 May 10 17:54:07.113527 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 467/921] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:06 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:54:08.143443 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-fa5f6440-e0a3-47a6-8d3d-a09cd98aff5a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:08.144029 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-fa5f6440-e0a3-47a6-8d3d-a09cd98aff5a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:08.153871 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fa5f6440-e0a3-47a6-8d3d-a09cd98aff5a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:08.154334 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fa5f6440-e0a3-47a6-8d3d-a09cd98aff5a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:08.155572 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fa5f6440-e0a3-47a6-8d3d-a09cd98aff5a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:08.156354 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fa5f6440-e0a3-47a6-8d3d-a09cd98aff5a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:08.397413 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fa5f6440-e0a3-47a6-8d3d-a09cd98aff5a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:08.413135 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fa5f6440-e0a3-47a6-8d3d-a09cd98aff5a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:08.416481 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fa5f6440-e0a3-47a6-8d3d-a09cd98aff5a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:08.419286 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-fa5f6440-e0a3-47a6-8d3d-a09cd98aff5a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1738 microversion: 2.20 time: 0.281388 May 10 17:54:08.420762 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 455/922] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:08 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1738 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:09.441130 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8618aaff-6863-4197-8934-b7f2cbd7edb5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:09.442101 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8618aaff-6863-4197-8934-b7f2cbd7edb5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:09.454226 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8618aaff-6863-4197-8934-b7f2cbd7edb5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:09.454684 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8618aaff-6863-4197-8934-b7f2cbd7edb5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:09.455504 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8618aaff-6863-4197-8934-b7f2cbd7edb5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:09.455948 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8618aaff-6863-4197-8934-b7f2cbd7edb5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:09.492495 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0094174d-04aa-490f-be13-6a58a5ec24c9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:09.493817 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0094174d-04aa-490f-be13-6a58a5ec24c9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:09.509864 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0094174d-04aa-490f-be13-6a58a5ec24c9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:09.510933 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0094174d-04aa-490f-be13-6a58a5ec24c9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:09.512715 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0094174d-04aa-490f-be13-6a58a5ec24c9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:09.514007 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0094174d-04aa-490f-be13-6a58a5ec24c9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:09.568784 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0094174d-04aa-490f-be13-6a58a5ec24c9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:54:09.680998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-8618aaff-6863-4197-8934-b7f2cbd7edb5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:09.697451 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-8618aaff-6863-4197-8934-b7f2cbd7edb5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:09.699999 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0094174d-04aa-490f-be13-6a58a5ec24c9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "DELETE /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 204 len: 0 microversion: 2.1 time: 0.213478 May 10 17:54:09.700540 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-8618aaff-6863-4197-8934-b7f2cbd7edb5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:09.703887 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 456/923] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:54:09 2022] DELETE /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:54:09.704068 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8618aaff-6863-4197-8934-b7f2cbd7edb5 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1738 microversion: 2.20 time: 0.267353 May 10 17:54:09.719930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 468/924] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:09 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1738 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:09.728612 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a83f0d56-51a4-4406-83eb-18bd51e6692b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:09.729423 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a83f0d56-51a4-4406-83eb-18bd51e6692b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:09.741635 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a83f0d56-51a4-4406-83eb-18bd51e6692b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:09.742325 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a83f0d56-51a4-4406-83eb-18bd51e6692b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:09.743614 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a83f0d56-51a4-4406-83eb-18bd51e6692b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:09.744617 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a83f0d56-51a4-4406-83eb-18bd51e6692b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:09.962890 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a83f0d56-51a4-4406-83eb-18bd51e6692b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:09.975473 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a83f0d56-51a4-4406-83eb-18bd51e6692b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1576 microversion: 2.1 time: 0.268004 May 10 17:54:09.979971 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 457/925] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:09 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1576 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:10.729195 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-576d26d9-39ac-46b2-96ec-7ce1d441f6b4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:10.729809 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-576d26d9-39ac-46b2-96ec-7ce1d441f6b4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:10.736717 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-576d26d9-39ac-46b2-96ec-7ce1d441f6b4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:10.737172 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-576d26d9-39ac-46b2-96ec-7ce1d441f6b4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:10.737980 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-576d26d9-39ac-46b2-96ec-7ce1d441f6b4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:10.738440 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-576d26d9-39ac-46b2-96ec-7ce1d441f6b4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:10.878454 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-576d26d9-39ac-46b2-96ec-7ce1d441f6b4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:10.887712 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-576d26d9-39ac-46b2-96ec-7ce1d441f6b4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:10.889268 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-576d26d9-39ac-46b2-96ec-7ce1d441f6b4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:10.890382 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-576d26d9-39ac-46b2-96ec-7ce1d441f6b4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1738 microversion: 2.20 time: 0.165238 May 10 17:54:10.890942 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 469/926] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:10 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:10.995152 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-abe8558a-8c24-4536-9859-1eaa36e8b439 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:10.995955 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-abe8558a-8c24-4536-9859-1eaa36e8b439 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:11.004662 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-abe8558a-8c24-4536-9859-1eaa36e8b439 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:11.005279 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-abe8558a-8c24-4536-9859-1eaa36e8b439 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:11.006702 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-abe8558a-8c24-4536-9859-1eaa36e8b439 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:11.007153 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-abe8558a-8c24-4536-9859-1eaa36e8b439 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:11.188598 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-abe8558a-8c24-4536-9859-1eaa36e8b439 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:11.198042 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-abe8558a-8c24-4536-9859-1eaa36e8b439 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1576 microversion: 2.1 time: 0.207620 May 10 17:54:11.199643 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 458/927] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:10 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1576 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:11.910075 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4d8a03c8-9f58-4ba9-ba9a-11e09da3692c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:11.910870 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4d8a03c8-9f58-4ba9-ba9a-11e09da3692c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:11.919304 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4d8a03c8-9f58-4ba9-ba9a-11e09da3692c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:11.919808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4d8a03c8-9f58-4ba9-ba9a-11e09da3692c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:11.920975 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4d8a03c8-9f58-4ba9-ba9a-11e09da3692c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:11.921159 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4d8a03c8-9f58-4ba9-ba9a-11e09da3692c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:12.196585 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4d8a03c8-9f58-4ba9-ba9a-11e09da3692c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:12.210342 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4d8a03c8-9f58-4ba9-ba9a-11e09da3692c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:12.213313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4d8a03c8-9f58-4ba9-ba9a-11e09da3692c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:12.213313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4d8a03c8-9f58-4ba9-ba9a-11e09da3692c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1738 microversion: 2.20 time: 0.307683 May 10 17:54:12.218306 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e0391082-24c4-49ad-9d38-6579f4447867 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:12.218936 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e0391082-24c4-49ad-9d38-6579f4447867 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:12.226742 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 470/928] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:11 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1738 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:54:12.230967 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e0391082-24c4-49ad-9d38-6579f4447867 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:12.231454 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e0391082-24c4-49ad-9d38-6579f4447867 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:12.232258 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e0391082-24c4-49ad-9d38-6579f4447867 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:12.232706 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e0391082-24c4-49ad-9d38-6579f4447867 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:12.533679 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e0391082-24c4-49ad-9d38-6579f4447867 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:12.542970 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e0391082-24c4-49ad-9d38-6579f4447867 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1576 microversion: 2.1 time: 0.328531 May 10 17:54:12.544139 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 459/929] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:12 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1576 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:54:13.226075 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-425ee781-e199-43f2-9599-7063042b2329 req-f1f1ffe8-5d52-44d3-811a-352f9e82f47d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55760f67-2403-45c9-8db7-d5ae5f45c366", "name": "network-vif-deleted", "tag": "d083dfb1-18c3-4ce4-aee5-72cf745b342b"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:54:13.249400 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0f1b87d0-888c-444d-b6d9-6ddf4365ce10 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:13.250154 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-425ee781-e199-43f2-9599-7063042b2329 req-f1f1ffe8-5d52-44d3-811a-352f9e82f47d service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:13.250270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-425ee781-e199-43f2-9599-7063042b2329 req-f1f1ffe8-5d52-44d3-811a-352f9e82f47d service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:13.276748 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-425ee781-e199-43f2-9599-7063042b2329 req-f1f1ffe8-5d52-44d3-811a-352f9e82f47d service nova] Creating event network-vif-deleted:d083dfb1-18c3-4ce4-aee5-72cf745b342b for instance 55760f67-2403-45c9-8db7-d5ae5f45c366 on hv-cinder-84130 May 10 17:54:13.278515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0f1b87d0-888c-444d-b6d9-6ddf4365ce10 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:13.289737 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-425ee781-e199-43f2-9599-7063042b2329 req-f1f1ffe8-5d52-44d3-811a-352f9e82f47d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067554 May 10 17:54:13.300682 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 471/930] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:54:13.309446 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f1b87d0-888c-444d-b6d9-6ddf4365ce10 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:13.310207 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f1b87d0-888c-444d-b6d9-6ddf4365ce10 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:13.311232 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f1b87d0-888c-444d-b6d9-6ddf4365ce10 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:13.311890 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0f1b87d0-888c-444d-b6d9-6ddf4365ce10 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:13.525689 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0f1b87d0-888c-444d-b6d9-6ddf4365ce10 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:13.536771 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0f1b87d0-888c-444d-b6d9-6ddf4365ce10 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:13.541200 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0f1b87d0-888c-444d-b6d9-6ddf4365ce10 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:13.543750 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0f1b87d0-888c-444d-b6d9-6ddf4365ce10 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1738 microversion: 2.20 time: 0.299150 May 10 17:54:13.544888 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 460/931] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:13 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1738 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:54:13.567382 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-12059bde-d794-4add-bf5e-2ec90f52bf9d tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:13.577347 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-12059bde-d794-4add-bf5e-2ec90f52bf9d tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:13.593998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-12059bde-d794-4add-bf5e-2ec90f52bf9d tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:13.594963 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-12059bde-d794-4add-bf5e-2ec90f52bf9d tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:13.596567 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-12059bde-d794-4add-bf5e-2ec90f52bf9d tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:13.597662 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-12059bde-d794-4add-bf5e-2ec90f52bf9d tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:13.754933 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-12059bde-d794-4add-bf5e-2ec90f52bf9d tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:13.786867 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-12059bde-d794-4add-bf5e-2ec90f52bf9d tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 200 len: 1225 microversion: 2.1 time: 0.227448 May 10 17:54:13.791422 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 472/932] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:13 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 1225 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:14.562216 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-07350177-0561-4eb3-931b-1606c25de24c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:14.562851 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-07350177-0561-4eb3-931b-1606c25de24c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:14.570777 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-07350177-0561-4eb3-931b-1606c25de24c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:14.571243 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-07350177-0561-4eb3-931b-1606c25de24c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:14.572088 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-07350177-0561-4eb3-931b-1606c25de24c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:14.572536 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-07350177-0561-4eb3-931b-1606c25de24c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:14.749050 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-07350177-0561-4eb3-931b-1606c25de24c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:14.759241 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-07350177-0561-4eb3-931b-1606c25de24c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:14.761003 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-07350177-0561-4eb3-931b-1606c25de24c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:14.762275 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-07350177-0561-4eb3-931b-1606c25de24c tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1738 microversion: 2.20 time: 0.203993 May 10 17:54:14.762975 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 461/933] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:14 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:54:14.804191 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9905cb7d-4b0e-4f28-9676-2788e8ba67fe tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:14.804896 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-9905cb7d-4b0e-4f28-9676-2788e8ba67fe tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:14.811847 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9905cb7d-4b0e-4f28-9676-2788e8ba67fe tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:14.812302 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9905cb7d-4b0e-4f28-9676-2788e8ba67fe tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:14.813090 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9905cb7d-4b0e-4f28-9676-2788e8ba67fe tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:14.813832 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9905cb7d-4b0e-4f28-9676-2788e8ba67fe tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:14.831031 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-9905cb7d-4b0e-4f28-9676-2788e8ba67fe tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] HTTP exception thrown: Instance 55760f67-2403-45c9-8db7-d5ae5f45c366 could not be found. May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9905cb7d-4b0e-4f28-9676-2788e8ba67fe tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Request method failure captured: May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 HTTP/1.1 May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqX2EGk80YwhkNBYpzSvIMQDlPkJh100D9TDT1w2DEUzIDMrBqmbDvF6KnvwYIYO0Y1CU26jIcmR_hkcQ0d-kJ4iRTJRmMNzvaf4TN6EFrBlPqfdbSd6xyeO8cEnI5lWeIO3QBW0WsQetnCHuiOv9I1wG-8dMfGHVMO0AlhgW_IrrwM May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: c93f0e69798e491aba3c8cf1493c2733 May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-TestVolumeBootPattern-524323740 May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:54:14.832796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:54:14.834637 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c93f0e69798e491aba3c8cf1493c2733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c93f0e69798e491aba3c8cf1493c2733"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c93f0e69798e491aba3c8cf1493c2733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c93f0e69798e491aba3c8cf1493c2733"}]}] May 10 17:54:14.834637 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-TestVolumeBootPattern-524323740 May 10 17:54:14.834637 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: c93f0e69798e491aba3c8cf1493c2733 May 10 17:54:14.834637 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-TestVolumeBootPattern-524323740 May 10 17:54:14.834637 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-TestVolumeBootPattern-524323740-project May 10 17:54:14.834637 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:54:14.834637 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:54:14.834637 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: 798edb753845410fa6f9c136b43abf05 May 10 17:54:14.834637 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-TestVolumeBootPattern-524323740-project May 10 17:54:14.834637 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:54:14.834637 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance 55760f67-2403-45c9-8db7-d5ae5f45c366 could not be found. May 10 17:54:14.834637 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': '55760f67-2403-45c9-8db7-d5ae5f45c366'} May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55760f67-2403-45c9-8db7-d5ae5f45c366 could not be found. May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:54:14.835595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:54:14.837128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:54:14.837128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:54:14.837128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:54:14.837128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:54:14.837128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:54:14.837128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:54:14.837128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:54:14.837128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55760f67-2403-45c9-8db7-d5ae5f45c366 could not be found. May 10 17:54:14.837128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:54:14.837128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:54:14.837128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:54:14.837128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:54:14.837128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:54:14.837128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:54:14.837128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:54:14.837128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:54:14.837128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55760f67-2403-45c9-8db7-d5ae5f45c366 could not be found. May 10 17:54:14.837128 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:54:14.838492 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9905cb7d-4b0e-4f28-9676-2788e8ba67fe tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Returning 404 to user: Instance 55760f67-2403-45c9-8db7-d5ae5f45c366 could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:54:14.838492 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-9905cb7d-4b0e-4f28-9676-2788e8ba67fe tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 404 len: 111 microversion: 2.1 time: 0.034848 May 10 17:54:14.838492 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 473/934] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:14 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:54:14.984481 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-cb4db333-116e-433c-a534-a278b9a27c74 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1255832621", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-630683051", "security_groups": [{"name": "tempest-secgroup-smoke-900555845"}], "block_device_mapping_v2": [{"uuid": "667edbaa-b7b7-45d3-890b-0efa80bff20b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0e710c0b-0b9b-4762-af88-7b56961d06bc"}]}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:54:15.099418 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.network.neutron [None req-cb4db333-116e-433c-a534-a278b9a27c74 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] validate_networks() for [('0e710c0b-0b9b-4762-af88-7b56961d06bc', None, None, None, None, None)] {{(pid=123752) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:54:15.487648 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cb4db333-116e-433c-a534-a278b9a27c74 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Flavor limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:54:15.488102 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cb4db333-116e-433c-a534-a278b9a27c74 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Image limits 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:54:15.488579 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cb4db333-116e-433c-a534-a278b9a27c74 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Flavor pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:54:15.488990 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cb4db333-116e-433c-a534-a278b9a27c74 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Image pref 0:0:0 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:54:15.489422 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.virt.hardware [None req-cb4db333-116e-433c-a534-a278b9a27c74 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123752) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:54:15.499083 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cb4db333-116e-433c-a534-a278b9a27c74 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:15.499568 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cb4db333-116e-433c-a534-a278b9a27c74 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:15.500367 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cb4db333-116e-433c-a534-a278b9a27c74 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:15.500804 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-cb4db333-116e-433c-a534-a278b9a27c74 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:15.517493 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-cb4db333-116e-433c-a534-a278b9a27c74 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Getting quotas for project c93f0e69798e491aba3c8cf1493c2733. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:54:15.522162 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-cb4db333-116e-433c-a534-a278b9a27c74 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Getting quotas for user 798edb753845410fa6f9c136b43abf05 and project c93f0e69798e491aba3c8cf1493c2733. Resources: {'ram', 'instances', 'cores'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:54:15.583769 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cb4db333-116e-433c-a534-a278b9a27c74 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Going to run 1 instances... {{(pid=123752) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:54:15.586021 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-cb4db333-116e-433c-a534-a278b9a27c74 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='667edbaa-b7b7-45d3-890b-0efa80bff20b',volume_size=None,volume_type=None)] {{(pid=123752) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:54:15.721909 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cb4db333-116e-433c-a534-a278b9a27c74 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [74429749-c6e3-43da-931d-951cb8604fc4] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 17:54:15.781737 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-88b1ecc2-bdf8-4759-8300-f3e6ba061e55 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:15.782287 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-88b1ecc2-bdf8-4759-8300-f3e6ba061e55 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:15.788479 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-88b1ecc2-bdf8-4759-8300-f3e6ba061e55 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:15.788926 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-88b1ecc2-bdf8-4759-8300-f3e6ba061e55 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:15.789709 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-88b1ecc2-bdf8-4759-8300-f3e6ba061e55 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:15.790149 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-88b1ecc2-bdf8-4759-8300-f3e6ba061e55 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:16.016756 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-88b1ecc2-bdf8-4759-8300-f3e6ba061e55 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:16.025088 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-88b1ecc2-bdf8-4759-8300-f3e6ba061e55 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:16.026607 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-88b1ecc2-bdf8-4759-8300-f3e6ba061e55 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:16.027829 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-88b1ecc2-bdf8-4759-8300-f3e6ba061e55 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1720 microversion: 2.20 time: 0.250233 May 10 17:54:16.028393 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 474/935] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:15 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1720 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:54:16.730501 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [None req-cb4db333-116e-433c-a534-a278b9a27c74 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [74429749-c6e3-43da-931d-951cb8604fc4] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 36634. May 10 17:54:16.734527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-cb4db333-116e-433c-a534-a278b9a27c74 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.754167 May 10 17:54:16.735183 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 462/936] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 17:54:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 1756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 10 17:54:16.745136 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-250ad750-ba76-496e-8681-6611936f77f8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:16.745755 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-250ad750-ba76-496e-8681-6611936f77f8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:16.806858 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-250ad750-ba76-496e-8681-6611936f77f8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:16.815238 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-250ad750-ba76-496e-8681-6611936f77f8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1094 microversion: 2.1 time: 0.073859 May 10 17:54:16.824732 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 475/937] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:16 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:54:17.046610 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3406e30d-22ea-43f7-84b9-54ca1c152587 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:17.047501 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3406e30d-22ea-43f7-84b9-54ca1c152587 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:17.055405 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3406e30d-22ea-43f7-84b9-54ca1c152587 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:17.055934 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3406e30d-22ea-43f7-84b9-54ca1c152587 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:17.056860 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3406e30d-22ea-43f7-84b9-54ca1c152587 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:17.057374 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3406e30d-22ea-43f7-84b9-54ca1c152587 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:17.201702 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3406e30d-22ea-43f7-84b9-54ca1c152587 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:17.210704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3406e30d-22ea-43f7-84b9-54ca1c152587 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:17.212243 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3406e30d-22ea-43f7-84b9-54ca1c152587 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:17.213429 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3406e30d-22ea-43f7-84b9-54ca1c152587 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1720 microversion: 2.20 time: 0.171221 May 10 17:54:17.214121 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 463/938] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:17 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:17.832263 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-0deb0659-cd97-4b16-a306-2d793f4cd696 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:17.832890 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-0deb0659-cd97-4b16-a306-2d793f4cd696 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:17.840391 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0deb0659-cd97-4b16-a306-2d793f4cd696 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:17.841035 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0deb0659-cd97-4b16-a306-2d793f4cd696 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:17.841621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0deb0659-cd97-4b16-a306-2d793f4cd696 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:17.842055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0deb0659-cd97-4b16-a306-2d793f4cd696 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:17.902780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-0deb0659-cd97-4b16-a306-2d793f4cd696 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:17.910204 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-0deb0659-cd97-4b16-a306-2d793f4cd696 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1144 microversion: 2.1 time: 0.081861 May 10 17:54:17.910765 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 476/939] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:17 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:18.231490 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5532725b-b2d6-40e2-92e6-8582881679a0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:18.232197 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5532725b-b2d6-40e2-92e6-8582881679a0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:18.240312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5532725b-b2d6-40e2-92e6-8582881679a0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:18.240763 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5532725b-b2d6-40e2-92e6-8582881679a0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:18.241588 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5532725b-b2d6-40e2-92e6-8582881679a0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:18.242026 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5532725b-b2d6-40e2-92e6-8582881679a0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:18.399835 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5532725b-b2d6-40e2-92e6-8582881679a0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:18.408425 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5532725b-b2d6-40e2-92e6-8582881679a0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:18.409993 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-5532725b-b2d6-40e2-92e6-8582881679a0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:18.411799 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5532725b-b2d6-40e2-92e6-8582881679a0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1720 microversion: 2.20 time: 0.183674 May 10 17:54:18.412444 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 464/940] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:18 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:54:18.928609 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fafb4d37-fff7-4a0d-9b29-8a3902009087 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:18.929213 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-fafb4d37-fff7-4a0d-9b29-8a3902009087 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:18.936091 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fafb4d37-fff7-4a0d-9b29-8a3902009087 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:18.936798 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fafb4d37-fff7-4a0d-9b29-8a3902009087 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:18.937619 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fafb4d37-fff7-4a0d-9b29-8a3902009087 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:18.938254 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fafb4d37-fff7-4a0d-9b29-8a3902009087 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:19.016406 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fafb4d37-fff7-4a0d-9b29-8a3902009087 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:19.024520 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-fafb4d37-fff7-4a0d-9b29-8a3902009087 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1200 microversion: 2.1 time: 0.100165 May 10 17:54:19.025090 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 477/941] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:18 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1200 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:19.431028 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c21e0752-fa4d-45f3-9ca4-bfb1ef523cbc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:19.431773 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c21e0752-fa4d-45f3-9ca4-bfb1ef523cbc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:19.438131 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c21e0752-fa4d-45f3-9ca4-bfb1ef523cbc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:19.438652 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c21e0752-fa4d-45f3-9ca4-bfb1ef523cbc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:19.439528 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c21e0752-fa4d-45f3-9ca4-bfb1ef523cbc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:19.440054 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c21e0752-fa4d-45f3-9ca4-bfb1ef523cbc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:19.620465 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c21e0752-fa4d-45f3-9ca4-bfb1ef523cbc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:19.628788 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c21e0752-fa4d-45f3-9ca4-bfb1ef523cbc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:19.630296 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c21e0752-fa4d-45f3-9ca4-bfb1ef523cbc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:19.631604 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c21e0752-fa4d-45f3-9ca4-bfb1ef523cbc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1663 microversion: 2.20 time: 0.205554 May 10 17:54:19.632176 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 465/942] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:19 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1663 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:19.650967 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e509b822-962f-44a6-948c-81d038b30d91 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "00d28cfe-1020-4a66-b54d-55a47f6ef0b6"}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:54:19.652551 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e509b822-962f-44a6-948c-81d038b30d91 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:19.658485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e509b822-962f-44a6-948c-81d038b30d91 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:19.659035 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e509b822-962f-44a6-948c-81d038b30d91 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:19.660016 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e509b822-962f-44a6-948c-81d038b30d91 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:19.660569 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e509b822-962f-44a6-948c-81d038b30d91 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:19.846173 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-ce8e00be-5240-4ca6-91b0-89a284d4d08f req-834fc584-0df0-4cb8-a75a-d287cb5776cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e16b7603-15a8-44a4-82c9-729bedfb8ac6", "name": "network-vif-unplugged", "status": "completed", "tag": "cb176284-f148-403c-b988-83b0bfbdd7dd"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:54:19.861558 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-ce8e00be-5240-4ca6-91b0-89a284d4d08f req-834fc584-0df0-4cb8-a75a-d287cb5776cc service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:19.863169 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-ce8e00be-5240-4ca6-91b0-89a284d4d08f req-834fc584-0df0-4cb8-a75a-d287cb5776cc service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:19.893037 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.compute.server_external_events [req-ce8e00be-5240-4ca6-91b0-89a284d4d08f req-834fc584-0df0-4cb8-a75a-d287cb5776cc service nova] Unable to find a host for instance e16b7603-15a8-44a4-82c9-729bedfb8ac6. Dropping event network-vif-unplugged {{(pid=123752) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 10 17:54:19.898505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-ce8e00be-5240-4ca6-91b0-89a284d4d08f req-834fc584-0df0-4cb8-a75a-d287cb5776cc service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.058141 May 10 17:54:19.912460 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 466/943] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 75 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 10 17:54:20.034745 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e509b822-962f-44a6-948c-81d038b30d91 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "POST /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.387782 May 10 17:54:20.035753 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 478/944] 10.222.0.60 () {62 vars in 1363 bytes} [Tue May 10 17:54:19 2022] POST /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6/os-volume_attachments => generated 188 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 10 17:54:20.046713 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-206fa31e-5fcd-4bc1-94cf-7d02f865cb18 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:20.047411 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-206fa31e-5fcd-4bc1-94cf-7d02f865cb18 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:20.058274 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-206fa31e-5fcd-4bc1-94cf-7d02f865cb18 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:20.058734 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-206fa31e-5fcd-4bc1-94cf-7d02f865cb18 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:20.059565 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-206fa31e-5fcd-4bc1-94cf-7d02f865cb18 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:20.060009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-206fa31e-5fcd-4bc1-94cf-7d02f865cb18 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:20.192912 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-608cb247-8cb4-42b9-9c90-4595402abe1a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:20.193767 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-608cb247-8cb4-42b9-9c90-4595402abe1a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:20.200574 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-608cb247-8cb4-42b9-9c90-4595402abe1a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:20.201108 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-608cb247-8cb4-42b9-9c90-4595402abe1a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:20.201970 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-608cb247-8cb4-42b9-9c90-4595402abe1a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:20.202659 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-608cb247-8cb4-42b9-9c90-4595402abe1a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:20.519652 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-608cb247-8cb4-42b9-9c90-4595402abe1a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6/os-volume_attachments/00d28cfe-1020-4a66-b54d-55a47f6ef0b6" status: 202 len: 0 microversion: 2.20 time: 0.330741 May 10 17:54:20.521419 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 479/945] 10.222.0.60 () {60 vars in 1456 bytes} [Tue May 10 17:54:20 2022] DELETE /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6/os-volume_attachments/00d28cfe-1020-4a66-b54d-55a47f6ef0b6 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 10 17:54:20.588555 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f0f25359-8476-495f-a46e-10a531164911 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:54:20.589153 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f0f25359-8476-495f-a46e-10a531164911 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:20.595503 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f0f25359-8476-495f-a46e-10a531164911 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:20.595962 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f0f25359-8476-495f-a46e-10a531164911 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:20.596747 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f0f25359-8476-495f-a46e-10a531164911 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:20.597192 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f0f25359-8476-495f-a46e-10a531164911 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:20.674550 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-206fa31e-5fcd-4bc1-94cf-7d02f865cb18 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:20.686668 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-206fa31e-5fcd-4bc1-94cf-7d02f865cb18 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.648501 May 10 17:54:20.687818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 467/946] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:20 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:54:20.698243 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a110c979-e3d5-4820-a3b4-fa2564ec883f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:20.699719 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a110c979-e3d5-4820-a3b4-fa2564ec883f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:20.709926 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a110c979-e3d5-4820-a3b4-fa2564ec883f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:20.710537 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a110c979-e3d5-4820-a3b4-fa2564ec883f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:20.711902 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a110c979-e3d5-4820-a3b4-fa2564ec883f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:20.712644 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a110c979-e3d5-4820-a3b4-fa2564ec883f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:20.727550 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f0f25359-8476-495f-a46e-10a531164911 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "POST /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6/action" status: 202 len: 0 microversion: 2.20 time: 0.143035 May 10 17:54:20.728313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 480/947] 10.222.0.60 () {62 vars in 1318 bytes} [Tue May 10 17:54:20 2022] POST /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 10 17:54:20.736556 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4e6ac541-68fb-4cce-9a16-9bda1f3e937b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:20.737096 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4e6ac541-68fb-4cce-9a16-9bda1f3e937b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:20.744238 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e6ac541-68fb-4cce-9a16-9bda1f3e937b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:20.744690 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e6ac541-68fb-4cce-9a16-9bda1f3e937b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:20.745483 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e6ac541-68fb-4cce-9a16-9bda1f3e937b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:20.745924 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e6ac541-68fb-4cce-9a16-9bda1f3e937b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:20.763409 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a110c979-e3d5-4820-a3b4-fa2564ec883f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e/ips" status: 200 len: 143 microversion: 2.1 time: 0.074083 May 10 17:54:20.764342 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 468/948] 10.222.0.60 () {58 vars in 1247 bytes} [Tue May 10 17:54:20 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e/ips => generated 143 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:54:20.979320 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4e6ac541-68fb-4cce-9a16-9bda1f3e937b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:20.992384 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4e6ac541-68fb-4cce-9a16-9bda1f3e937b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:20.994038 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4e6ac541-68fb-4cce-9a16-9bda1f3e937b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:20.995683 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4e6ac541-68fb-4cce-9a16-9bda1f3e937b tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1671 microversion: 2.20 time: 0.263032 May 10 17:54:20.997367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 481/949] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:20 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1671 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:54:21.205025 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-4e3984f2-5ab1-43da-ac0e-6157de13f82a req-d033f2c7-f512-46f4-8bc6-822781ada9b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b778e508-4f5a-4514-babe-5f0868a5d485", "tag": "ede42f21-9c07-4946-b657-fdd16056f502"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:54:21.215752 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-4e3984f2-5ab1-43da-ac0e-6157de13f82a req-d033f2c7-f512-46f4-8bc6-822781ada9b7 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:21.216448 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-4e3984f2-5ab1-43da-ac0e-6157de13f82a req-d033f2c7-f512-46f4-8bc6-822781ada9b7 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:21.245024 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-4e3984f2-5ab1-43da-ac0e-6157de13f82a req-d033f2c7-f512-46f4-8bc6-822781ada9b7 service nova] Creating event network-changed:ede42f21-9c07-4946-b657-fdd16056f502 for instance b778e508-4f5a-4514-babe-5f0868a5d485 on hv-cinder-84130 May 10 17:54:21.262872 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-4e3984f2-5ab1-43da-ac0e-6157de13f82a req-d033f2c7-f512-46f4-8bc6-822781ada9b7 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061698 May 10 17:54:21.265173 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 469/950] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:54:21.714239 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7a9b0ba2-b695-4611-b567-79babcb4b5c8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:21.716936 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7a9b0ba2-b695-4611-b567-79babcb4b5c8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:21.726378 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7a9b0ba2-b695-4611-b567-79babcb4b5c8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:21.728120 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7a9b0ba2-b695-4611-b567-79babcb4b5c8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:21.729166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7a9b0ba2-b695-4611-b567-79babcb4b5c8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:21.729610 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7a9b0ba2-b695-4611-b567-79babcb4b5c8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:21.987259 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7a9b0ba2-b695-4611-b567-79babcb4b5c8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:21.997167 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7a9b0ba2-b695-4611-b567-79babcb4b5c8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.287090 May 10 17:54:22.011777 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 482/951] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:21 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:22.017006 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-af29381e-5ac2-4d04-8fb9-bd07a5a73602 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:22.017719 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-af29381e-5ac2-4d04-8fb9-bd07a5a73602 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:22.024707 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af29381e-5ac2-4d04-8fb9-bd07a5a73602 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:22.025169 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af29381e-5ac2-4d04-8fb9-bd07a5a73602 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:22.026307 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af29381e-5ac2-4d04-8fb9-bd07a5a73602 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:22.026762 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af29381e-5ac2-4d04-8fb9-bd07a5a73602 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:22.191730 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-af29381e-5ac2-4d04-8fb9-bd07a5a73602 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:22.201049 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-af29381e-5ac2-4d04-8fb9-bd07a5a73602 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:22.202548 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-af29381e-5ac2-4d04-8fb9-bd07a5a73602 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:22.203757 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-af29381e-5ac2-4d04-8fb9-bd07a5a73602 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1671 microversion: 2.20 time: 0.192260 May 10 17:54:22.204323 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 470/952] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:22 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1671 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:23.029626 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-05d808ee-78ec-43ab-ad57-23962894d610 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:23.029626 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-05d808ee-78ec-43ab-ad57-23962894d610 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:23.039169 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-05d808ee-78ec-43ab-ad57-23962894d610 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:23.039741 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-05d808ee-78ec-43ab-ad57-23962894d610 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:23.040639 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-05d808ee-78ec-43ab-ad57-23962894d610 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:23.041150 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-05d808ee-78ec-43ab-ad57-23962894d610 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:23.156144 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7821804c-435f-4251-9211-b18b6b295942 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbc19591-95ce-4b62-bd5c-1db336260a2e"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:54:23.157626 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7821804c-435f-4251-9211-b18b6b295942 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:23.164675 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7821804c-435f-4251-9211-b18b6b295942 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:23.165383 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7821804c-435f-4251-9211-b18b6b295942 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:23.166181 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7821804c-435f-4251-9211-b18b6b295942 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:23.166619 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7821804c-435f-4251-9211-b18b6b295942 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:23.257483 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-05d808ee-78ec-43ab-ad57-23962894d610 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:23.265389 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-05d808ee-78ec-43ab-ad57-23962894d610 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.242427 May 10 17:54:23.265994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 483/953] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:23 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:23.271150 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1d9799bf-4fe2-4e58-b584-cdcfa4f787d4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:23.271848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-1d9799bf-4fe2-4e58-b584-cdcfa4f787d4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:23.277787 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1d9799bf-4fe2-4e58-b584-cdcfa4f787d4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:23.278246 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1d9799bf-4fe2-4e58-b584-cdcfa4f787d4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:23.279019 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1d9799bf-4fe2-4e58-b584-cdcfa4f787d4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:23.279497 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1d9799bf-4fe2-4e58-b584-cdcfa4f787d4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:23.489797 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1d9799bf-4fe2-4e58-b584-cdcfa4f787d4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:23.499432 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1d9799bf-4fe2-4e58-b584-cdcfa4f787d4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:23.502029 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1d9799bf-4fe2-4e58-b584-cdcfa4f787d4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:23.504472 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-1d9799bf-4fe2-4e58-b584-cdcfa4f787d4 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.236841 May 10 17:54:23.507452 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 484/954] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:23 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:23.536329 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7821804c-435f-4251-9211-b18b6b295942 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "POST /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383668 May 10 17:54:23.537347 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 471/955] 10.222.0.60 () {60 vars in 1322 bytes} [Tue May 10 17:54:23 2022] POST /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e/os-volume_attachments => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:54:24.287123 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-88ce13a9-de3e-42df-9506-448fc7bd0dfe tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:24.287744 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-88ce13a9-de3e-42df-9506-448fc7bd0dfe tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:24.294359 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-88ce13a9-de3e-42df-9506-448fc7bd0dfe tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:24.294812 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-88ce13a9-de3e-42df-9506-448fc7bd0dfe tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:24.295617 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-88ce13a9-de3e-42df-9506-448fc7bd0dfe tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:24.296054 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-88ce13a9-de3e-42df-9506-448fc7bd0dfe tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:24.473222 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-88ce13a9-de3e-42df-9506-448fc7bd0dfe tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:24.482312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-88ce13a9-de3e-42df-9506-448fc7bd0dfe tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.201539 May 10 17:54:24.482799 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 485/956] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:24 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:54:24.535486 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-19b31b9f-1b20-4b19-a29d-3d30af1d8819 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:24.537001 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-19b31b9f-1b20-4b19-a29d-3d30af1d8819 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:24.555055 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19b31b9f-1b20-4b19-a29d-3d30af1d8819 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:24.555544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19b31b9f-1b20-4b19-a29d-3d30af1d8819 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:24.556414 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19b31b9f-1b20-4b19-a29d-3d30af1d8819 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:24.556889 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19b31b9f-1b20-4b19-a29d-3d30af1d8819 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:24.740974 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-19b31b9f-1b20-4b19-a29d-3d30af1d8819 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:24.751318 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-19b31b9f-1b20-4b19-a29d-3d30af1d8819 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:24.753510 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-19b31b9f-1b20-4b19-a29d-3d30af1d8819 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:24.756688 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-19b31b9f-1b20-4b19-a29d-3d30af1d8819 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.225708 May 10 17:54:24.757917 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 472/957] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:24 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:25.499502 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-d3e59124-2e5f-4467-8f25-9287d03053ab tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:25.500188 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-d3e59124-2e5f-4467-8f25-9287d03053ab tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:25.511424 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d3e59124-2e5f-4467-8f25-9287d03053ab tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:25.512146 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d3e59124-2e5f-4467-8f25-9287d03053ab tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:25.513140 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d3e59124-2e5f-4467-8f25-9287d03053ab tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:25.513745 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d3e59124-2e5f-4467-8f25-9287d03053ab tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:25.686817 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-d3e59124-2e5f-4467-8f25-9287d03053ab tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:25.695609 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-d3e59124-2e5f-4467-8f25-9287d03053ab tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.199873 May 10 17:54:25.696310 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 486/958] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:25 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:25.780846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7b380b7a-9708-4dc4-b666-62ce64451227 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:25.780846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7b380b7a-9708-4dc4-b666-62ce64451227 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:25.791490 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b380b7a-9708-4dc4-b666-62ce64451227 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:25.792084 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b380b7a-9708-4dc4-b666-62ce64451227 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:25.793128 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b380b7a-9708-4dc4-b666-62ce64451227 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:25.793685 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7b380b7a-9708-4dc4-b666-62ce64451227 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:25.939811 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7b380b7a-9708-4dc4-b666-62ce64451227 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:25.949678 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7b380b7a-9708-4dc4-b666-62ce64451227 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:25.951413 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7b380b7a-9708-4dc4-b666-62ce64451227 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:25.952618 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7b380b7a-9708-4dc4-b666-62ce64451227 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.179918 May 10 17:54:25.953185 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 473/959] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:25 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:26.717356 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c0fbbbed-7c0f-4b1b-92cf-982dc22c96dd tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:26.717989 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c0fbbbed-7c0f-4b1b-92cf-982dc22c96dd tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:26.725139 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c0fbbbed-7c0f-4b1b-92cf-982dc22c96dd tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:26.725597 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c0fbbbed-7c0f-4b1b-92cf-982dc22c96dd tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:26.726394 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c0fbbbed-7c0f-4b1b-92cf-982dc22c96dd tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:26.726833 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c0fbbbed-7c0f-4b1b-92cf-982dc22c96dd tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:26.885312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c0fbbbed-7c0f-4b1b-92cf-982dc22c96dd tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:26.893358 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c0fbbbed-7c0f-4b1b-92cf-982dc22c96dd tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.179964 May 10 17:54:26.894233 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 487/960] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:26 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:26.971248 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e7b7939e-2dfa-4942-99a4-674429f5a7ef tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:26.971840 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e7b7939e-2dfa-4942-99a4-674429f5a7ef tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:26.981379 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7b7939e-2dfa-4942-99a4-674429f5a7ef tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:26.981846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7b7939e-2dfa-4942-99a4-674429f5a7ef tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:26.982665 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7b7939e-2dfa-4942-99a4-674429f5a7ef tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:26.983115 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7b7939e-2dfa-4942-99a4-674429f5a7ef tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:27.140025 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e7b7939e-2dfa-4942-99a4-674429f5a7ef tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:27.149371 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e7b7939e-2dfa-4942-99a4-674429f5a7ef tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:27.150895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e7b7939e-2dfa-4942-99a4-674429f5a7ef tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:27.152150 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e7b7939e-2dfa-4942-99a4-674429f5a7ef tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.185054 May 10 17:54:27.152714 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 474/961] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:26 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:27.912429 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5bd69d5b-aa2a-4cd2-a73c-b73385c6f269 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:27.913083 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5bd69d5b-aa2a-4cd2-a73c-b73385c6f269 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:27.921888 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5bd69d5b-aa2a-4cd2-a73c-b73385c6f269 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:27.923599 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5bd69d5b-aa2a-4cd2-a73c-b73385c6f269 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:27.925214 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5bd69d5b-aa2a-4cd2-a73c-b73385c6f269 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:27.926137 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5bd69d5b-aa2a-4cd2-a73c-b73385c6f269 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:28.084041 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-5bd69d5b-aa2a-4cd2-a73c-b73385c6f269 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:28.094476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-5bd69d5b-aa2a-4cd2-a73c-b73385c6f269 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.186920 May 10 17:54:28.095066 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 488/962] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:27 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:28.170844 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0991e4c2-da2a-4856-9da4-1cace4a9c1f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:28.171473 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0991e4c2-da2a-4856-9da4-1cace4a9c1f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:28.178253 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0991e4c2-da2a-4856-9da4-1cace4a9c1f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:28.178703 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0991e4c2-da2a-4856-9da4-1cace4a9c1f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:28.179517 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0991e4c2-da2a-4856-9da4-1cace4a9c1f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:28.179962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0991e4c2-da2a-4856-9da4-1cace4a9c1f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:28.348997 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0991e4c2-da2a-4856-9da4-1cace4a9c1f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:28.357851 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0991e4c2-da2a-4856-9da4-1cace4a9c1f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:28.359738 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0991e4c2-da2a-4856-9da4-1cace4a9c1f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:28.361176 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0991e4c2-da2a-4856-9da4-1cace4a9c1f1 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.194589 May 10 17:54:28.372491 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 475/963] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:28 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:29.113525 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e59fa507-1ebb-4c69-bdca-dc8e9f6e9aea tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:29.114724 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e59fa507-1ebb-4c69-bdca-dc8e9f6e9aea tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:29.122302 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e59fa507-1ebb-4c69-bdca-dc8e9f6e9aea tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:29.123059 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e59fa507-1ebb-4c69-bdca-dc8e9f6e9aea tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:29.123966 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e59fa507-1ebb-4c69-bdca-dc8e9f6e9aea tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:29.124488 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e59fa507-1ebb-4c69-bdca-dc8e9f6e9aea tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:29.287047 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e59fa507-1ebb-4c69-bdca-dc8e9f6e9aea tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:29.304347 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e59fa507-1ebb-4c69-bdca-dc8e9f6e9aea tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.195157 May 10 17:54:29.311514 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 489/964] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:29 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:29.380024 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7531aa86-ef1e-49fa-86a9-c7e34a3404d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:29.380672 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-7531aa86-ef1e-49fa-86a9-c7e34a3404d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:29.388491 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7531aa86-ef1e-49fa-86a9-c7e34a3404d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:29.389171 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7531aa86-ef1e-49fa-86a9-c7e34a3404d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:29.390494 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7531aa86-ef1e-49fa-86a9-c7e34a3404d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:29.391064 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-7531aa86-ef1e-49fa-86a9-c7e34a3404d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:29.560892 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7531aa86-ef1e-49fa-86a9-c7e34a3404d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:29.578278 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7531aa86-ef1e-49fa-86a9-c7e34a3404d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:29.582085 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-7531aa86-ef1e-49fa-86a9-c7e34a3404d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:29.584946 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7531aa86-ef1e-49fa-86a9-c7e34a3404d0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.209241 May 10 17:54:29.598009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 476/965] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:29 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:30.329860 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-bf851256-7d8a-4912-a16a-6d583aadc0e9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:30.330746 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-bf851256-7d8a-4912-a16a-6d583aadc0e9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:30.338108 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bf851256-7d8a-4912-a16a-6d583aadc0e9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:30.338984 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bf851256-7d8a-4912-a16a-6d583aadc0e9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:30.340092 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bf851256-7d8a-4912-a16a-6d583aadc0e9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:30.340787 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bf851256-7d8a-4912-a16a-6d583aadc0e9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:30.536832 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-bf851256-7d8a-4912-a16a-6d583aadc0e9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:30.554058 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-bf851256-7d8a-4912-a16a-6d583aadc0e9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.227445 May 10 17:54:30.556729 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 490/966] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:30 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:30.608777 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6174a2f5-d3ae-4629-a9b2-3e6849f97db7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:30.609585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6174a2f5-d3ae-4629-a9b2-3e6849f97db7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:30.616245 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6174a2f5-d3ae-4629-a9b2-3e6849f97db7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:30.616707 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6174a2f5-d3ae-4629-a9b2-3e6849f97db7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:30.617502 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6174a2f5-d3ae-4629-a9b2-3e6849f97db7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:30.617942 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6174a2f5-d3ae-4629-a9b2-3e6849f97db7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:30.782137 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6174a2f5-d3ae-4629-a9b2-3e6849f97db7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:30.791702 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6174a2f5-d3ae-4629-a9b2-3e6849f97db7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:30.793229 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6174a2f5-d3ae-4629-a9b2-3e6849f97db7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:30.794450 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6174a2f5-d3ae-4629-a9b2-3e6849f97db7 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.189795 May 10 17:54:30.795016 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 477/967] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:30 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:54:31.572644 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c39b7956-3071-4183-aade-02b96356313b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:31.574418 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c39b7956-3071-4183-aade-02b96356313b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:31.584918 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c39b7956-3071-4183-aade-02b96356313b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:31.585624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c39b7956-3071-4183-aade-02b96356313b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:31.587512 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c39b7956-3071-4183-aade-02b96356313b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:31.588314 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c39b7956-3071-4183-aade-02b96356313b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:31.803169 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c39b7956-3071-4183-aade-02b96356313b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:31.821349 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c88b7a73-6e45-4b2e-ba80-8f02d5c35a03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:31.822134 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c88b7a73-6e45-4b2e-ba80-8f02d5c35a03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:31.829320 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c88b7a73-6e45-4b2e-ba80-8f02d5c35a03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:31.829885 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c88b7a73-6e45-4b2e-ba80-8f02d5c35a03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:31.830639 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c39b7956-3071-4183-aade-02b96356313b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.261942 May 10 17:54:31.830818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c88b7a73-6e45-4b2e-ba80-8f02d5c35a03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:31.831152 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c88b7a73-6e45-4b2e-ba80-8f02d5c35a03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:31.836227 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 491/968] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:31 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:31.997473 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c88b7a73-6e45-4b2e-ba80-8f02d5c35a03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:32.008227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c88b7a73-6e45-4b2e-ba80-8f02d5c35a03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:32.009921 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c88b7a73-6e45-4b2e-ba80-8f02d5c35a03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:32.011123 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c88b7a73-6e45-4b2e-ba80-8f02d5c35a03 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.201648 May 10 17:54:32.011783 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 478/969] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:31 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:32.851915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-51ea9b60-a063-4222-b681-552233052e49 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:32.853021 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-51ea9b60-a063-4222-b681-552233052e49 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:32.860188 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-51ea9b60-a063-4222-b681-552233052e49 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:32.860802 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-51ea9b60-a063-4222-b681-552233052e49 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:32.861617 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-51ea9b60-a063-4222-b681-552233052e49 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:32.862069 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-51ea9b60-a063-4222-b681-552233052e49 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:33.036157 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ce76ab21-9f57-4255-bcf5-9d7b5f9a3684 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:33.036896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ce76ab21-9f57-4255-bcf5-9d7b5f9a3684 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:33.044992 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ce76ab21-9f57-4255-bcf5-9d7b5f9a3684 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:33.045813 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ce76ab21-9f57-4255-bcf5-9d7b5f9a3684 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:33.046893 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ce76ab21-9f57-4255-bcf5-9d7b5f9a3684 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:33.047560 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ce76ab21-9f57-4255-bcf5-9d7b5f9a3684 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:33.194732 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-51ea9b60-a063-4222-b681-552233052e49 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:33.212998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-51ea9b60-a063-4222-b681-552233052e49 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.366806 May 10 17:54:33.214447 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 492/970] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:32 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:54:33.246147 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ce76ab21-9f57-4255-bcf5-9d7b5f9a3684 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:33.263911 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ce76ab21-9f57-4255-bcf5-9d7b5f9a3684 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:33.266209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ce76ab21-9f57-4255-bcf5-9d7b5f9a3684 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:33.267502 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ce76ab21-9f57-4255-bcf5-9d7b5f9a3684 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.236151 May 10 17:54:33.268090 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 479/971] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:33 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:34.237945 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7c735e53-0295-4346-a911-5bbe929b6d4e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:34.238585 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7c735e53-0295-4346-a911-5bbe929b6d4e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:34.245651 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7c735e53-0295-4346-a911-5bbe929b6d4e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:34.246101 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7c735e53-0295-4346-a911-5bbe929b6d4e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:34.246895 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7c735e53-0295-4346-a911-5bbe929b6d4e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:34.247334 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7c735e53-0295-4346-a911-5bbe929b6d4e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:34.286563 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ac7c9cea-837e-48bd-9c8b-20e5577ca941 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:34.287265 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ac7c9cea-837e-48bd-9c8b-20e5577ca941 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:34.295994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ac7c9cea-837e-48bd-9c8b-20e5577ca941 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:34.296852 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ac7c9cea-837e-48bd-9c8b-20e5577ca941 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:34.297595 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ac7c9cea-837e-48bd-9c8b-20e5577ca941 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:34.298068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ac7c9cea-837e-48bd-9c8b-20e5577ca941 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:34.448660 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7c735e53-0295-4346-a911-5bbe929b6d4e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:34.459002 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7c735e53-0295-4346-a911-5bbe929b6d4e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.224890 May 10 17:54:34.459672 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 493/972] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:34 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:34.472993 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ac7c9cea-837e-48bd-9c8b-20e5577ca941 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:34.480978 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ac7c9cea-837e-48bd-9c8b-20e5577ca941 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:34.482494 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-ac7c9cea-837e-48bd-9c8b-20e5577ca941 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:34.483687 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ac7c9cea-837e-48bd-9c8b-20e5577ca941 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.202029 May 10 17:54:34.484254 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 480/973] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:34 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:54:35.476826 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4e08f283-6559-4343-a5cf-ec2c073994af tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:35.477453 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4e08f283-6559-4343-a5cf-ec2c073994af tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:35.483973 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e08f283-6559-4343-a5cf-ec2c073994af tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:35.484431 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e08f283-6559-4343-a5cf-ec2c073994af tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:35.485209 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e08f283-6559-4343-a5cf-ec2c073994af tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:35.485657 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e08f283-6559-4343-a5cf-ec2c073994af tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:35.501161 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3160ee26-ba1b-4448-b301-6dbbdb3f6266 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:35.501987 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3160ee26-ba1b-4448-b301-6dbbdb3f6266 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:35.509183 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3160ee26-ba1b-4448-b301-6dbbdb3f6266 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:35.509635 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3160ee26-ba1b-4448-b301-6dbbdb3f6266 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:35.510427 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3160ee26-ba1b-4448-b301-6dbbdb3f6266 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:35.510866 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3160ee26-ba1b-4448-b301-6dbbdb3f6266 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:35.668361 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4e08f283-6559-4343-a5cf-ec2c073994af tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:35.676011 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4e08f283-6559-4343-a5cf-ec2c073994af tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.203830 May 10 17:54:35.677303 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 494/974] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:35 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:35.734840 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3160ee26-ba1b-4448-b301-6dbbdb3f6266 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:35.743295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3160ee26-ba1b-4448-b301-6dbbdb3f6266 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:35.744836 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3160ee26-ba1b-4448-b301-6dbbdb3f6266 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:35.746032 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3160ee26-ba1b-4448-b301-6dbbdb3f6266 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.248933 May 10 17:54:35.746601 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 481/975] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:35 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:54:36.694639 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-94fd7741-30f4-418b-9f5d-c910ccd794f4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:36.695238 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-94fd7741-30f4-418b-9f5d-c910ccd794f4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:36.702437 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-94fd7741-30f4-418b-9f5d-c910ccd794f4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:36.702885 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-94fd7741-30f4-418b-9f5d-c910ccd794f4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:36.703686 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-94fd7741-30f4-418b-9f5d-c910ccd794f4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:36.704415 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-94fd7741-30f4-418b-9f5d-c910ccd794f4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:36.764776 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-fd156486-afbd-4296-9923-62531e452424 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:36.765486 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-fd156486-afbd-4296-9923-62531e452424 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:36.772766 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fd156486-afbd-4296-9923-62531e452424 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:36.773586 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fd156486-afbd-4296-9923-62531e452424 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:36.774383 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fd156486-afbd-4296-9923-62531e452424 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:36.774828 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fd156486-afbd-4296-9923-62531e452424 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:36.887411 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-94fd7741-30f4-418b-9f5d-c910ccd794f4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:36.894932 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-94fd7741-30f4-418b-9f5d-c910ccd794f4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.204993 May 10 17:54:36.896842 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 495/976] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:36 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:36.936776 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fd156486-afbd-4296-9923-62531e452424 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:36.946026 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fd156486-afbd-4296-9923-62531e452424 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:36.947491 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fd156486-afbd-4296-9923-62531e452424 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:36.948692 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-fd156486-afbd-4296-9923-62531e452424 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.187949 May 10 17:54:36.949516 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 482/977] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:36 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:37.913994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b9848db3-7d40-46f6-8feb-5a5ff6ee5f05 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:37.914619 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-b9848db3-7d40-46f6-8feb-5a5ff6ee5f05 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:37.921207 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b9848db3-7d40-46f6-8feb-5a5ff6ee5f05 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:37.921657 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b9848db3-7d40-46f6-8feb-5a5ff6ee5f05 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:37.922428 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b9848db3-7d40-46f6-8feb-5a5ff6ee5f05 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:37.922864 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b9848db3-7d40-46f6-8feb-5a5ff6ee5f05 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:37.967576 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-353d870d-479b-4b87-902a-11acf65a35cd tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:37.968284 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-353d870d-479b-4b87-902a-11acf65a35cd tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:37.977715 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-353d870d-479b-4b87-902a-11acf65a35cd tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:37.978164 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-353d870d-479b-4b87-902a-11acf65a35cd tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:37.978983 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-353d870d-479b-4b87-902a-11acf65a35cd tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:37.979455 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-353d870d-479b-4b87-902a-11acf65a35cd tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:38.099151 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b9848db3-7d40-46f6-8feb-5a5ff6ee5f05 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:38.109192 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b9848db3-7d40-46f6-8feb-5a5ff6ee5f05 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.199610 May 10 17:54:38.109790 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 496/978] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:37 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:38.140892 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-353d870d-479b-4b87-902a-11acf65a35cd tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:38.150460 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-353d870d-479b-4b87-902a-11acf65a35cd tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:38.151977 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-353d870d-479b-4b87-902a-11acf65a35cd tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:38.153150 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-353d870d-479b-4b87-902a-11acf65a35cd tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.189569 May 10 17:54:38.153700 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 483/979] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:37 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:39.126831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a23fc42e-1168-434c-9fcb-f4f2465323f6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:39.127440 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a23fc42e-1168-434c-9fcb-f4f2465323f6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:39.133740 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a23fc42e-1168-434c-9fcb-f4f2465323f6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:39.134181 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a23fc42e-1168-434c-9fcb-f4f2465323f6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:39.134934 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a23fc42e-1168-434c-9fcb-f4f2465323f6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:39.135386 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a23fc42e-1168-434c-9fcb-f4f2465323f6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:39.170069 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e337b9fb-3813-49fe-9dc8-525335dc4ba6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:39.171194 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e337b9fb-3813-49fe-9dc8-525335dc4ba6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:39.177698 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e337b9fb-3813-49fe-9dc8-525335dc4ba6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:39.178157 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e337b9fb-3813-49fe-9dc8-525335dc4ba6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:39.178950 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e337b9fb-3813-49fe-9dc8-525335dc4ba6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:39.179416 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e337b9fb-3813-49fe-9dc8-525335dc4ba6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:39.317298 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a23fc42e-1168-434c-9fcb-f4f2465323f6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:39.328557 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a23fc42e-1168-434c-9fcb-f4f2465323f6 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.205596 May 10 17:54:39.330516 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 497/980] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:39 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:39.351817 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e337b9fb-3813-49fe-9dc8-525335dc4ba6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:39.360048 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e337b9fb-3813-49fe-9dc8-525335dc4ba6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:39.361552 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e337b9fb-3813-49fe-9dc8-525335dc4ba6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:39.362728 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e337b9fb-3813-49fe-9dc8-525335dc4ba6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.196625 May 10 17:54:39.363298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 484/981] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:39 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:54:40.351161 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-973b4157-17be-4975-98fb-85f56af4ced1 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:40.351808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-973b4157-17be-4975-98fb-85f56af4ced1 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:40.358213 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-973b4157-17be-4975-98fb-85f56af4ced1 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:40.358665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-973b4157-17be-4975-98fb-85f56af4ced1 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:40.359468 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-973b4157-17be-4975-98fb-85f56af4ced1 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:40.359907 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-973b4157-17be-4975-98fb-85f56af4ced1 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:40.382022 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f6f43217-bc1d-445a-ae59-3c765ee92762 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:40.382882 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f6f43217-bc1d-445a-ae59-3c765ee92762 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:40.389783 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f6f43217-bc1d-445a-ae59-3c765ee92762 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:40.390248 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f6f43217-bc1d-445a-ae59-3c765ee92762 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:40.391033 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f6f43217-bc1d-445a-ae59-3c765ee92762 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:40.391502 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f6f43217-bc1d-445a-ae59-3c765ee92762 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:40.575770 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-973b4157-17be-4975-98fb-85f56af4ced1 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:40.580583 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f6f43217-bc1d-445a-ae59-3c765ee92762 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:40.584720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-973b4157-17be-4975-98fb-85f56af4ced1 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.240978 May 10 17:54:40.585510 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 498/982] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:40 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:40.596908 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f6f43217-bc1d-445a-ae59-3c765ee92762 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:40.598410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f6f43217-bc1d-445a-ae59-3c765ee92762 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:40.599648 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f6f43217-bc1d-445a-ae59-3c765ee92762 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.222715 May 10 17:54:40.600337 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 485/983] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:40 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:41.601966 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-401c8330-3875-412e-9703-5ff892ac4dd7 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:41.602579 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-401c8330-3875-412e-9703-5ff892ac4dd7 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:41.609016 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-401c8330-3875-412e-9703-5ff892ac4dd7 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:41.609547 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-401c8330-3875-412e-9703-5ff892ac4dd7 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:41.610318 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-401c8330-3875-412e-9703-5ff892ac4dd7 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:41.610754 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-401c8330-3875-412e-9703-5ff892ac4dd7 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:41.617851 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a0f76c0c-4ed9-4067-b667-6afa3431ff06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:41.618466 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a0f76c0c-4ed9-4067-b667-6afa3431ff06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:41.625099 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0f76c0c-4ed9-4067-b667-6afa3431ff06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:41.625556 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0f76c0c-4ed9-4067-b667-6afa3431ff06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:41.626341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0f76c0c-4ed9-4067-b667-6afa3431ff06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:41.626789 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a0f76c0c-4ed9-4067-b667-6afa3431ff06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:41.940741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a0f76c0c-4ed9-4067-b667-6afa3431ff06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:41.950042 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-401c8330-3875-412e-9703-5ff892ac4dd7 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:41.952079 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a0f76c0c-4ed9-4067-b667-6afa3431ff06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:41.953678 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a0f76c0c-4ed9-4067-b667-6afa3431ff06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:41.955028 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a0f76c0c-4ed9-4067-b667-6afa3431ff06 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.341269 May 10 17:54:41.956405 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 486/984] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:41 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:54:41.972441 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-401c8330-3875-412e-9703-5ff892ac4dd7 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.374233 May 10 17:54:41.973685 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 499/985] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:41 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:41.975762 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-fe5976a0-e403-4e82-9ee0-66897af9e885 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:54:41.984834 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fe5976a0-e403-4e82-9ee0-66897af9e885 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:41.985475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fe5976a0-e403-4e82-9ee0-66897af9e885 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:42.051794 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-fe5976a0-e403-4e82-9ee0-66897af9e885 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Going to try to stop instance {{(pid=123752) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 17:54:42.099808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-a2431636-6909-48a8-95fb-ce6eadfd3523 req-1d33ed3b-30d9-41d2-878f-ee2a92065c63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b778e508-4f5a-4514-babe-5f0868a5d485", "name": "network-vif-plugged", "status": "completed", "tag": "ede42f21-9c07-4946-b657-fdd16056f502"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:54:42.100710 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-fe5976a0-e403-4e82-9ee0-66897af9e885 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "POST /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e/action" status: 202 len: 0 microversion: 2.1 time: 0.141819 May 10 17:54:42.101405 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 487/986] 10.222.0.60 () {60 vars in 1277 bytes} [Tue May 10 17:54:41 2022] POST /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:54:42.109646 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-a2431636-6909-48a8-95fb-ce6eadfd3523 req-1d33ed3b-30d9-41d2-878f-ee2a92065c63 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:42.110514 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-a2431636-6909-48a8-95fb-ce6eadfd3523 req-1d33ed3b-30d9-41d2-878f-ee2a92065c63 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:42.112595 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-adfb8a44-e614-4b17-9198-0c51f8b74685 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:42.113754 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-adfb8a44-e614-4b17-9198-0c51f8b74685 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:42.122452 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-adfb8a44-e614-4b17-9198-0c51f8b74685 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:42.123259 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-adfb8a44-e614-4b17-9198-0c51f8b74685 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:42.123836 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-adfb8a44-e614-4b17-9198-0c51f8b74685 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:42.124346 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-adfb8a44-e614-4b17-9198-0c51f8b74685 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:42.125665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-a2431636-6909-48a8-95fb-ce6eadfd3523 req-1d33ed3b-30d9-41d2-878f-ee2a92065c63 service nova] Creating event network-vif-plugged:ede42f21-9c07-4946-b657-fdd16056f502 for instance b778e508-4f5a-4514-babe-5f0868a5d485 on hv-cinder-84130 May 10 17:54:42.133411 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-a2431636-6909-48a8-95fb-ce6eadfd3523 req-1d33ed3b-30d9-41d2-878f-ee2a92065c63 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037596 May 10 17:54:42.134289 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 500/987] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:54:42.264653 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-adfb8a44-e614-4b17-9198-0c51f8b74685 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:42.273631 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-adfb8a44-e614-4b17-9198-0c51f8b74685 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1721 microversion: 2.1 time: 0.167909 May 10 17:54:42.274221 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 488/988] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:42 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:54:42.976868 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9281a243-06d2-4374-b83f-8f677a47ee5e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:42.977558 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-9281a243-06d2-4374-b83f-8f677a47ee5e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:42.983879 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9281a243-06d2-4374-b83f-8f677a47ee5e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:42.984362 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9281a243-06d2-4374-b83f-8f677a47ee5e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:42.985140 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9281a243-06d2-4374-b83f-8f677a47ee5e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:42.985581 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9281a243-06d2-4374-b83f-8f677a47ee5e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:42.990020 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-dcccf44a-06b6-4867-9859-20c8eb98819b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:42.990886 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-dcccf44a-06b6-4867-9859-20c8eb98819b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:42.997356 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dcccf44a-06b6-4867-9859-20c8eb98819b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:42.997822 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dcccf44a-06b6-4867-9859-20c8eb98819b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:42.998637 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dcccf44a-06b6-4867-9859-20c8eb98819b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:42.999075 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dcccf44a-06b6-4867-9859-20c8eb98819b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:43.183399 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-9281a243-06d2-4374-b83f-8f677a47ee5e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:43.191476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-9281a243-06d2-4374-b83f-8f677a47ee5e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:43.191877 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-dcccf44a-06b6-4867-9859-20c8eb98819b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:43.192970 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-9281a243-06d2-4374-b83f-8f677a47ee5e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:43.194463 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-9281a243-06d2-4374-b83f-8f677a47ee5e tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.222876 May 10 17:54:43.195101 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 501/989] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:42 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:54:43.199941 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-dcccf44a-06b6-4867-9859-20c8eb98819b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.213862 May 10 17:54:43.200585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 489/990] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:42 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:54:43.290849 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1cb2b138-d3b2-4ebb-999e-1018cd1f74d8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:43.291391 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-1cb2b138-d3b2-4ebb-999e-1018cd1f74d8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:43.297341 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1cb2b138-d3b2-4ebb-999e-1018cd1f74d8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:43.297789 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1cb2b138-d3b2-4ebb-999e-1018cd1f74d8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:43.298557 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1cb2b138-d3b2-4ebb-999e-1018cd1f74d8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:43.298995 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1cb2b138-d3b2-4ebb-999e-1018cd1f74d8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:43.427935 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1cb2b138-d3b2-4ebb-999e-1018cd1f74d8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:43.435711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-1cb2b138-d3b2-4ebb-999e-1018cd1f74d8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1721 microversion: 2.1 time: 0.148813 May 10 17:54:43.436280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 502/991] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:43 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:44.149435 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-731b9bbd-3c14-49ab-9aa4-41d6fe402daa req-9d0e9f73-aea7-4f45-b318-e2a16c5c27ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e16b7603-15a8-44a4-82c9-729bedfb8ac6", "name": "network-vif-plugged", "status": "completed", "tag": "cb176284-f148-403c-b988-83b0bfbdd7dd"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:54:44.157914 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-731b9bbd-3c14-49ab-9aa4-41d6fe402daa req-9d0e9f73-aea7-4f45-b318-e2a16c5c27ae service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:44.158361 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-731b9bbd-3c14-49ab-9aa4-41d6fe402daa req-9d0e9f73-aea7-4f45-b318-e2a16c5c27ae service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:44.169836 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-731b9bbd-3c14-49ab-9aa4-41d6fe402daa req-9d0e9f73-aea7-4f45-b318-e2a16c5c27ae service nova] Creating event network-vif-plugged:cb176284-f148-403c-b988-83b0bfbdd7dd for instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 on hv-cinder-84130 May 10 17:54:44.174561 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-731b9bbd-3c14-49ab-9aa4-41d6fe402daa req-9d0e9f73-aea7-4f45-b318-e2a16c5c27ae service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029014 May 10 17:54:44.175139 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 490/992] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:54:44.214118 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-801efde0-7bed-4238-b67a-e1efbe95c2ba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:44.214690 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-801efde0-7bed-4238-b67a-e1efbe95c2ba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:44.216941 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-fcdf25b2-8d32-4052-9a3f-73021b2b1045 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:44.217644 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-fcdf25b2-8d32-4052-9a3f-73021b2b1045 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:44.220885 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-801efde0-7bed-4238-b67a-e1efbe95c2ba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:44.221358 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-801efde0-7bed-4238-b67a-e1efbe95c2ba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:44.222171 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-801efde0-7bed-4238-b67a-e1efbe95c2ba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:44.222618 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-801efde0-7bed-4238-b67a-e1efbe95c2ba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:44.223962 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fcdf25b2-8d32-4052-9a3f-73021b2b1045 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:44.224415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fcdf25b2-8d32-4052-9a3f-73021b2b1045 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:44.225404 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fcdf25b2-8d32-4052-9a3f-73021b2b1045 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:44.225954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fcdf25b2-8d32-4052-9a3f-73021b2b1045 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:44.436561 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fcdf25b2-8d32-4052-9a3f-73021b2b1045 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:44.440761 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-801efde0-7bed-4238-b67a-e1efbe95c2ba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:44.446063 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-fcdf25b2-8d32-4052-9a3f-73021b2b1045 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1265 microversion: 2.1 time: 0.232335 May 10 17:54:44.446063 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 491/993] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:44 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:54:44.451283 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-801efde0-7bed-4238-b67a-e1efbe95c2ba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:44.452994 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-801efde0-7bed-4238-b67a-e1efbe95c2ba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:44.454224 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-801efde0-7bed-4238-b67a-e1efbe95c2ba tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.245336 May 10 17:54:44.454894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 503/994] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:44 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:44.456103 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e9bb92a1-7e35-4aa1-8588-ea07de62c299 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:44.456904 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e9bb92a1-7e35-4aa1-8588-ea07de62c299 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:44.464134 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e9bb92a1-7e35-4aa1-8588-ea07de62c299 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:44.464613 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e9bb92a1-7e35-4aa1-8588-ea07de62c299 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:44.465383 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e9bb92a1-7e35-4aa1-8588-ea07de62c299 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:44.465832 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e9bb92a1-7e35-4aa1-8588-ea07de62c299 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:44.598876 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e9bb92a1-7e35-4aa1-8588-ea07de62c299 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:44.606792 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e9bb92a1-7e35-4aa1-8588-ea07de62c299 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1721 microversion: 2.1 time: 0.154875 May 10 17:54:44.607353 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 492/995] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:44 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:54:45.463878 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-05b9e626-8cb5-46f2-b908-c927e556f623 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:45.464476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-05b9e626-8cb5-46f2-b908-c927e556f623 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:45.470912 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-05b9e626-8cb5-46f2-b908-c927e556f623 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:45.471383 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-05b9e626-8cb5-46f2-b908-c927e556f623 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:45.472155 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-05b9e626-8cb5-46f2-b908-c927e556f623 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:45.472587 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-05b9e626-8cb5-46f2-b908-c927e556f623 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:45.473119 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a2cb70e4-14a7-4974-835f-2a20b6e209ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:45.473726 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a2cb70e4-14a7-4974-835f-2a20b6e209ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:45.480884 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a2cb70e4-14a7-4974-835f-2a20b6e209ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:45.481336 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a2cb70e4-14a7-4974-835f-2a20b6e209ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:45.482105 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a2cb70e4-14a7-4974-835f-2a20b6e209ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:45.482540 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a2cb70e4-14a7-4974-835f-2a20b6e209ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:45.645205 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-05b9e626-8cb5-46f2-b908-c927e556f623 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:45.653246 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-05b9e626-8cb5-46f2-b908-c927e556f623 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1451 microversion: 2.1 time: 0.193194 May 10 17:54:45.653818 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 504/996] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:45 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1451 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:45.658318 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8198df54-33e8-4a0a-ac40-1f8024cb23ad tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:45.658861 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8198df54-33e8-4a0a-ac40-1f8024cb23ad tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:45.664715 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8198df54-33e8-4a0a-ac40-1f8024cb23ad tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:45.665291 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8198df54-33e8-4a0a-ac40-1f8024cb23ad tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:45.666040 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8198df54-33e8-4a0a-ac40-1f8024cb23ad tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:45.666482 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8198df54-33e8-4a0a-ac40-1f8024cb23ad tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:45.817466 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a2cb70e4-14a7-4974-835f-2a20b6e209ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:45.825542 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-8198df54-33e8-4a0a-ac40-1f8024cb23ad tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:45.826547 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a2cb70e4-14a7-4974-835f-2a20b6e209ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:45.828169 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a2cb70e4-14a7-4974-835f-2a20b6e209ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:45.829350 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a2cb70e4-14a7-4974-835f-2a20b6e209ab tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.360351 May 10 17:54:45.829919 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 493/997] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:45 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 10 17:54:45.835101 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c8470938-e73f-4275-bbe3-85b19fa2f93a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:45.835736 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c8470938-e73f-4275-bbe3-85b19fa2f93a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:45.841558 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8198df54-33e8-4a0a-ac40-1f8024cb23ad tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1721 microversion: 2.1 time: 0.186704 May 10 17:54:45.841836 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c8470938-e73f-4275-bbe3-85b19fa2f93a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:45.842351 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 505/998] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:45 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:45.842477 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c8470938-e73f-4275-bbe3-85b19fa2f93a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:45.843067 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c8470938-e73f-4275-bbe3-85b19fa2f93a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:45.843541 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c8470938-e73f-4275-bbe3-85b19fa2f93a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:45.974366 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c8470938-e73f-4275-bbe3-85b19fa2f93a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:45.982466 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c8470938-e73f-4275-bbe3-85b19fa2f93a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1451 microversion: 2.1 time: 0.151451 May 10 17:54:45.983032 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 494/999] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:45 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:46.850302 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fd75f076-a591-45c7-9f3f-15e7a2a48bf0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:46.850943 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-fd75f076-a591-45c7-9f3f-15e7a2a48bf0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:46.860190 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fd75f076-a591-45c7-9f3f-15e7a2a48bf0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:46.860860 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fd75f076-a591-45c7-9f3f-15e7a2a48bf0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:46.861170 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-206f7392-b5c1-4c8f-9125-cb22f574fc8c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:46.861656 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fd75f076-a591-45c7-9f3f-15e7a2a48bf0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:46.862059 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-206f7392-b5c1-4c8f-9125-cb22f574fc8c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:46.862460 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fd75f076-a591-45c7-9f3f-15e7a2a48bf0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:46.871754 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-206f7392-b5c1-4c8f-9125-cb22f574fc8c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:46.872816 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-206f7392-b5c1-4c8f-9125-cb22f574fc8c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:46.873641 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-206f7392-b5c1-4c8f-9125-cb22f574fc8c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:46.874667 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-206f7392-b5c1-4c8f-9125-cb22f574fc8c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:47.092621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fd75f076-a591-45c7-9f3f-15e7a2a48bf0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:47.103792 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fd75f076-a591-45c7-9f3f-15e7a2a48bf0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:47.105716 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fd75f076-a591-45c7-9f3f-15e7a2a48bf0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:47.107062 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-fd75f076-a591-45c7-9f3f-15e7a2a48bf0 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1729 microversion: 2.20 time: 0.262028 May 10 17:54:47.108019 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 506/1000] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:46 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1729 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:47.119497 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-206f7392-b5c1-4c8f-9125-cb22f574fc8c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:47.128494 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-206f7392-b5c1-4c8f-9125-cb22f574fc8c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1721 microversion: 2.1 time: 0.273733 May 10 17:54:47.129353 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 495/1001] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:46 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1721 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:54:47.879297 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-4a059c22-bb1b-4a1f-b1d0-29f6056b7c2f req-304fe939-3a14-4cd2-9aca-2fdd84a8322b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b778e508-4f5a-4514-babe-5f0868a5d485", "tag": "ede42f21-9c07-4946-b657-fdd16056f502"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:54:47.889116 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-4a059c22-bb1b-4a1f-b1d0-29f6056b7c2f req-304fe939-3a14-4cd2-9aca-2fdd84a8322b service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:47.889565 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-4a059c22-bb1b-4a1f-b1d0-29f6056b7c2f req-304fe939-3a14-4cd2-9aca-2fdd84a8322b service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:47.902553 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-4a059c22-bb1b-4a1f-b1d0-29f6056b7c2f req-304fe939-3a14-4cd2-9aca-2fdd84a8322b service nova] Creating event network-changed:ede42f21-9c07-4946-b657-fdd16056f502 for instance b778e508-4f5a-4514-babe-5f0868a5d485 on hv-cinder-84130 May 10 17:54:47.907673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-4a059c22-bb1b-4a1f-b1d0-29f6056b7c2f req-304fe939-3a14-4cd2-9aca-2fdd84a8322b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032473 May 10 17:54:47.908274 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 507/1002] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:54:48.126580 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-17b65282-0564-48ee-ba39-f1db1ef487db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:48.127521 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-17b65282-0564-48ee-ba39-f1db1ef487db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:48.135816 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-17b65282-0564-48ee-ba39-f1db1ef487db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:48.136283 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-17b65282-0564-48ee-ba39-f1db1ef487db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:48.137092 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-17b65282-0564-48ee-ba39-f1db1ef487db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:48.137541 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-17b65282-0564-48ee-ba39-f1db1ef487db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:48.149911 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fb1d595b-1546-4681-9e97-88dcd26247ec tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:48.151738 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-fb1d595b-1546-4681-9e97-88dcd26247ec tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:48.159675 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fb1d595b-1546-4681-9e97-88dcd26247ec tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:48.160533 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fb1d595b-1546-4681-9e97-88dcd26247ec tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:48.161565 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fb1d595b-1546-4681-9e97-88dcd26247ec tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:48.163714 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fb1d595b-1546-4681-9e97-88dcd26247ec tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:48.410977 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-17b65282-0564-48ee-ba39-f1db1ef487db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:48.421132 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-17b65282-0564-48ee-ba39-f1db1ef487db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:48.423314 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-17b65282-0564-48ee-ba39-f1db1ef487db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:48.425131 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-17b65282-0564-48ee-ba39-f1db1ef487db tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1716 microversion: 2.20 time: 0.302253 May 10 17:54:48.426009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 496/1003] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:54:48 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1716 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:54:48.438812 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fb1d595b-1546-4681-9e97-88dcd26247ec tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:48.441473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-fb1d595b-1546-4681-9e97-88dcd26247ec tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1721 microversion: 2.1 time: 0.300079 May 10 17:54:48.447463 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 508/1004] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:48 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1721 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:49.460569 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-88ed0cf9-1ce1-4b66-9715-7d4b7339c4d4 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:49.461179 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-88ed0cf9-1ce1-4b66-9715-7d4b7339c4d4 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:49.467686 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-88ed0cf9-1ce1-4b66-9715-7d4b7339c4d4 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:49.468139 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-88ed0cf9-1ce1-4b66-9715-7d4b7339c4d4 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:49.468921 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-88ed0cf9-1ce1-4b66-9715-7d4b7339c4d4 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:49.469358 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-88ed0cf9-1ce1-4b66-9715-7d4b7339c4d4 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:49.606132 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-88ed0cf9-1ce1-4b66-9715-7d4b7339c4d4 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:49.613938 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-88ed0cf9-1ce1-4b66-9715-7d4b7339c4d4 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1721 microversion: 2.1 time: 0.157980 May 10 17:54:49.614506 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 497/1005] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:49 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:54:50.631634 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-74ee8e3d-6f62-47c5-977f-85d9cb4b309d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:50.632231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-74ee8e3d-6f62-47c5-977f-85d9cb4b309d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:50.638568 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-74ee8e3d-6f62-47c5-977f-85d9cb4b309d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:50.639013 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-74ee8e3d-6f62-47c5-977f-85d9cb4b309d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:50.639798 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-74ee8e3d-6f62-47c5-977f-85d9cb4b309d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:50.640233 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-74ee8e3d-6f62-47c5-977f-85d9cb4b309d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:50.773376 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-74ee8e3d-6f62-47c5-977f-85d9cb4b309d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:50.781177 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-74ee8e3d-6f62-47c5-977f-85d9cb4b309d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1721 microversion: 2.1 time: 0.153635 May 10 17:54:50.781748 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 509/1006] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:50 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:51.798158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0350bcb3-9072-48d6-82bd-b7e9be371ad6 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:51.798775 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0350bcb3-9072-48d6-82bd-b7e9be371ad6 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:51.806120 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0350bcb3-9072-48d6-82bd-b7e9be371ad6 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:51.806571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0350bcb3-9072-48d6-82bd-b7e9be371ad6 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:51.807341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0350bcb3-9072-48d6-82bd-b7e9be371ad6 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:51.807820 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0350bcb3-9072-48d6-82bd-b7e9be371ad6 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:51.938232 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0350bcb3-9072-48d6-82bd-b7e9be371ad6 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:51.946472 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0350bcb3-9072-48d6-82bd-b7e9be371ad6 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1721 microversion: 2.1 time: 0.152334 May 10 17:54:51.947040 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 498/1007] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:51 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:52.963733 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-6c590b0f-e5e0-4446-bb16-f5142251281d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:52.964374 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-6c590b0f-e5e0-4446-bb16-f5142251281d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:52.971047 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6c590b0f-e5e0-4446-bb16-f5142251281d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:52.971534 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6c590b0f-e5e0-4446-bb16-f5142251281d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:52.972313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6c590b0f-e5e0-4446-bb16-f5142251281d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:52.972780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-6c590b0f-e5e0-4446-bb16-f5142251281d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:53.108849 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-6c590b0f-e5e0-4446-bb16-f5142251281d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:53.117289 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-6c590b0f-e5e0-4446-bb16-f5142251281d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1721 microversion: 2.1 time: 0.157511 May 10 17:54:53.117850 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 510/1008] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:52 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:54.134462 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-29753a71-06fa-4318-a990-f17b6ae128c2 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:54.135103 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-29753a71-06fa-4318-a990-f17b6ae128c2 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:54.141423 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-29753a71-06fa-4318-a990-f17b6ae128c2 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:54.141872 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-29753a71-06fa-4318-a990-f17b6ae128c2 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:54.142647 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-29753a71-06fa-4318-a990-f17b6ae128c2 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:54.143080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-29753a71-06fa-4318-a990-f17b6ae128c2 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:54.537254 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-29753a71-06fa-4318-a990-f17b6ae128c2 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:54.545286 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-29753a71-06fa-4318-a990-f17b6ae128c2 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1721 microversion: 2.1 time: 0.414996 May 10 17:54:54.545849 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 499/1009] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:54 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1721 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:55.562183 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b069f1c0-b365-4ed0-aae0-7f188ab3cffc tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:55.562798 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-b069f1c0-b365-4ed0-aae0-7f188ab3cffc tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:55.568970 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b069f1c0-b365-4ed0-aae0-7f188ab3cffc tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:55.569439 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b069f1c0-b365-4ed0-aae0-7f188ab3cffc tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:55.570543 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b069f1c0-b365-4ed0-aae0-7f188ab3cffc tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:55.570979 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b069f1c0-b365-4ed0-aae0-7f188ab3cffc tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:55.702035 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b069f1c0-b365-4ed0-aae0-7f188ab3cffc tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:55.709914 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b069f1c0-b365-4ed0-aae0-7f188ab3cffc tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1721 microversion: 2.1 time: 0.151696 May 10 17:54:55.711166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 511/1010] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:55 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:56.731141 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-13bd5692-c5f5-45b5-9a40-4f223fa08752 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:56.731788 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-13bd5692-c5f5-45b5-9a40-4f223fa08752 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:56.738134 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-13bd5692-c5f5-45b5-9a40-4f223fa08752 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:56.738593 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-13bd5692-c5f5-45b5-9a40-4f223fa08752 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:56.739403 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-13bd5692-c5f5-45b5-9a40-4f223fa08752 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:56.739840 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-13bd5692-c5f5-45b5-9a40-4f223fa08752 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:56.873570 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-13bd5692-c5f5-45b5-9a40-4f223fa08752 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:56.881413 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-13bd5692-c5f5-45b5-9a40-4f223fa08752 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1721 microversion: 2.1 time: 0.154216 May 10 17:54:56.881981 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 500/1011] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:56 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:57.898368 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a664c60d-8b66-4299-9611-6694429c2061 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:57.899096 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a664c60d-8b66-4299-9611-6694429c2061 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:57.905506 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a664c60d-8b66-4299-9611-6694429c2061 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:57.905952 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a664c60d-8b66-4299-9611-6694429c2061 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:57.906711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a664c60d-8b66-4299-9611-6694429c2061 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:57.907144 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a664c60d-8b66-4299-9611-6694429c2061 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:58.034864 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a664c60d-8b66-4299-9611-6694429c2061 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:58.042658 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a664c60d-8b66-4299-9611-6694429c2061 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1698 microversion: 2.1 time: 0.148278 May 10 17:54:58.043224 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 512/1012] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:57 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1698 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:58.060215 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-59215438-7f53-4554-8bcf-f351c010ee40 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:54:58.066668 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-59215438-7f53-4554-8bcf-f351c010ee40 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:58.067127 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-59215438-7f53-4554-8bcf-f351c010ee40 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:58.091147 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-59215438-7f53-4554-8bcf-f351c010ee40 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Going to try to start instance {{(pid=123752) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 17:54:58.133943 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-59215438-7f53-4554-8bcf-f351c010ee40 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "POST /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e/action" status: 202 len: 0 microversion: 2.1 time: 0.076416 May 10 17:54:58.134555 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 501/1013] 10.222.0.60 () {60 vars in 1277 bytes} [Tue May 10 17:54:58 2022] POST /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:54:58.142728 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ded5c793-3403-45cf-949e-2dbc6f42f92f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:58.143353 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ded5c793-3403-45cf-949e-2dbc6f42f92f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:58.150608 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ded5c793-3403-45cf-949e-2dbc6f42f92f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:58.151127 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ded5c793-3403-45cf-949e-2dbc6f42f92f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:58.152012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ded5c793-3403-45cf-949e-2dbc6f42f92f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:58.153038 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ded5c793-3403-45cf-949e-2dbc6f42f92f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:58.297706 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-ded5c793-3403-45cf-949e-2dbc6f42f92f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:58.306516 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ded5c793-3403-45cf-949e-2dbc6f42f92f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1707 microversion: 2.1 time: 0.167569 May 10 17:54:58.307110 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 513/1014] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:58 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1707 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:54:59.325799 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3f513fb2-c11b-4f8a-9dac-405a040fb586 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:54:59.326566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3f513fb2-c11b-4f8a-9dac-405a040fb586 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:54:59.332691 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3f513fb2-c11b-4f8a-9dac-405a040fb586 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:59.333150 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3f513fb2-c11b-4f8a-9dac-405a040fb586 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:59.333939 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3f513fb2-c11b-4f8a-9dac-405a040fb586 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:54:59.334382 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3f513fb2-c11b-4f8a-9dac-405a040fb586 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:54:59.466965 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3f513fb2-c11b-4f8a-9dac-405a040fb586 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:54:59.474817 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3f513fb2-c11b-4f8a-9dac-405a040fb586 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1707 microversion: 2.1 time: 0.153949 May 10 17:54:59.475609 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 502/1015] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:54:59 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1707 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:55:00.491432 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-96e75ac9-4519-4a7e-8e42-255467343720 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:00.492457 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-96e75ac9-4519-4a7e-8e42-255467343720 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:00.498486 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-96e75ac9-4519-4a7e-8e42-255467343720 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:00.499037 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-96e75ac9-4519-4a7e-8e42-255467343720 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:00.499839 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-96e75ac9-4519-4a7e-8e42-255467343720 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:00.500266 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-96e75ac9-4519-4a7e-8e42-255467343720 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:00.628731 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-96e75ac9-4519-4a7e-8e42-255467343720 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:55:00.637249 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-96e75ac9-4519-4a7e-8e42-255467343720 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1711 microversion: 2.1 time: 0.149712 May 10 17:55:00.637826 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 514/1016] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:55:00 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1711 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:55:22.316607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-93fa05b0-50f5-49c6-97ec-5dbd5d46ac80 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:22.317236 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-93fa05b0-50f5-49c6-97ec-5dbd5d46ac80 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:22.324190 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-93fa05b0-50f5-49c6-97ec-5dbd5d46ac80 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:22.324899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-93fa05b0-50f5-49c6-97ec-5dbd5d46ac80 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:22.325792 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-93fa05b0-50f5-49c6-97ec-5dbd5d46ac80 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:22.326227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-93fa05b0-50f5-49c6-97ec-5dbd5d46ac80 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:22.349535 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-93fa05b0-50f5-49c6-97ec-5dbd5d46ac80 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086/ips" status: 200 len: 150 microversion: 2.1 time: 0.036799 May 10 17:55:22.350113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 503/1017] 10.222.0.60 () {58 vars in 1247 bytes} [Tue May 10 17:55:22 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:55:23.657244 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-cd12d97d-bf52-4fcb-833f-1be63036bea0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d0761dc-d434-447a-a19a-4a4c9ebcc245"}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:55:23.658803 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-cd12d97d-bf52-4fcb-833f-1be63036bea0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:23.665538 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cd12d97d-bf52-4fcb-833f-1be63036bea0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:23.665988 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cd12d97d-bf52-4fcb-833f-1be63036bea0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:23.666749 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cd12d97d-bf52-4fcb-833f-1be63036bea0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:23.667182 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cd12d97d-bf52-4fcb-833f-1be63036bea0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:23.935676 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-cd12d97d-bf52-4fcb-833f-1be63036bea0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "POST /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282047 May 10 17:55:23.936450 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 515/1018] 10.222.0.60 () {60 vars in 1322 bytes} [Tue May 10 17:55:23 2022] POST /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:55:31.519620 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ff9c9c7b-5afd-4816-8ab0-0b9d6e1e4c74 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:31.520181 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ff9c9c7b-5afd-4816-8ab0-0b9d6e1e4c74 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:31.526879 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ff9c9c7b-5afd-4816-8ab0-0b9d6e1e4c74 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:31.527325 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ff9c9c7b-5afd-4816-8ab0-0b9d6e1e4c74 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:31.528148 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ff9c9c7b-5afd-4816-8ab0-0b9d6e1e4c74 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:31.528585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ff9c9c7b-5afd-4816-8ab0-0b9d6e1e4c74 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:31.609913 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-ff9c9c7b-5afd-4816-8ab0-0b9d6e1e4c74 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lazy-loading 'services' on Instance uuid b20de23a-a487-4289-9b7f-e82881619086 {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:55:31.681236 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ff9c9c7b-5afd-4816-8ab0-0b9d6e1e4c74 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086/os-volume_attachments/9d0761dc-d434-447a-a19a-4a4c9ebcc245" status: 202 len: 0 microversion: 2.1 time: 0.165380 May 10 17:55:31.681854 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 504/1019] 10.222.0.60 () {58 vars in 1415 bytes} [Tue May 10 17:55:31 2022] DELETE /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086/os-volume_attachments/9d0761dc-d434-447a-a19a-4a4c9ebcc245 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:55:31.691102 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8300d310-e654-45d3-a70a-bd894fce07f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:31.692145 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8300d310-e654-45d3-a70a-bd894fce07f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:31.698326 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8300d310-e654-45d3-a70a-bd894fce07f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:31.698796 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8300d310-e654-45d3-a70a-bd894fce07f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:31.699907 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8300d310-e654-45d3-a70a-bd894fce07f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:31.700352 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8300d310-e654-45d3-a70a-bd894fce07f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:31.731131 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8300d310-e654-45d3-a70a-bd894fce07f2 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044723 May 10 17:55:31.731733 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 516/1020] 10.222.0.60 () {58 vars in 1301 bytes} [Tue May 10 17:55:31 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:55:32.745925 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ffa431d2-fbc1-4957-8822-f0c5e369522b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:32.746979 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ffa431d2-fbc1-4957-8822-f0c5e369522b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:32.753180 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ffa431d2-fbc1-4957-8822-f0c5e369522b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:32.753626 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ffa431d2-fbc1-4957-8822-f0c5e369522b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:32.754393 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ffa431d2-fbc1-4957-8822-f0c5e369522b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:32.754827 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ffa431d2-fbc1-4957-8822-f0c5e369522b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:32.782349 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ffa431d2-fbc1-4957-8822-f0c5e369522b tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042180 May 10 17:55:32.782898 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 505/1021] 10.222.0.60 () {58 vars in 1301 bytes} [Tue May 10 17:55:32 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:55:32.839479 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a729819e-ef19-437d-bf38-fafab313e726 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:32.839985 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a729819e-ef19-437d-bf38-fafab313e726 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:32.847507 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a729819e-ef19-437d-bf38-fafab313e726 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:32.847907 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a729819e-ef19-437d-bf38-fafab313e726 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:32.848678 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a729819e-ef19-437d-bf38-fafab313e726 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:32.849114 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a729819e-ef19-437d-bf38-fafab313e726 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:32.874996 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a729819e-ef19-437d-bf38-fafab313e726 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Going to try to terminate instance {{(pid=123753) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:55:32.949392 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a729819e-ef19-437d-bf38-fafab313e726 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 204 len: 0 microversion: 2.1 time: 0.113785 May 10 17:55:32.950242 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 517/1022] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:55:32 2022] DELETE /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:55:32.959698 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-8f341821-2d8a-4260-bd56-269ecd5f7690 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:32.960303 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-8f341821-2d8a-4260-bd56-269ecd5f7690 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:32.966182 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8f341821-2d8a-4260-bd56-269ecd5f7690 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:32.967637 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8f341821-2d8a-4260-bd56-269ecd5f7690 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:32.967637 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8f341821-2d8a-4260-bd56-269ecd5f7690 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:32.967872 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-8f341821-2d8a-4260-bd56-269ecd5f7690 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:33.105864 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-8f341821-2d8a-4260-bd56-269ecd5f7690 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:55:33.113748 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-8f341821-2d8a-4260-bd56-269ecd5f7690 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 200 len: 1681 microversion: 2.1 time: 0.158001 May 10 17:55:33.114324 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 506/1023] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:55:32 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:55:34.133005 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b9dab901-362d-4153-8342-f8a4926b8d0c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:34.133688 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-b9dab901-362d-4153-8342-f8a4926b8d0c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:34.141011 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b9dab901-362d-4153-8342-f8a4926b8d0c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:34.141461 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b9dab901-362d-4153-8342-f8a4926b8d0c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:34.142232 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b9dab901-362d-4153-8342-f8a4926b8d0c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:34.142669 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b9dab901-362d-4153-8342-f8a4926b8d0c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:34.280356 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b9dab901-362d-4153-8342-f8a4926b8d0c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:55:34.287799 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b9dab901-362d-4153-8342-f8a4926b8d0c tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 200 len: 1681 microversion: 2.1 time: 0.159698 May 10 17:55:34.288366 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 518/1024] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:55:34 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:55:35.306824 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-233a2c68-75ab-4b30-b00d-3d60485713e5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:35.307492 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-233a2c68-75ab-4b30-b00d-3d60485713e5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:35.314163 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-233a2c68-75ab-4b30-b00d-3d60485713e5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:35.314617 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-233a2c68-75ab-4b30-b00d-3d60485713e5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:35.315680 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-233a2c68-75ab-4b30-b00d-3d60485713e5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:35.316121 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-233a2c68-75ab-4b30-b00d-3d60485713e5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:35.534923 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-233a2c68-75ab-4b30-b00d-3d60485713e5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:55:35.543284 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-233a2c68-75ab-4b30-b00d-3d60485713e5 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 200 len: 1681 microversion: 2.1 time: 0.241080 May 10 17:55:35.543884 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 507/1025] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:55:35 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 1681 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:55:36.092728 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-0b1bafb9-366e-49fc-81fd-ef7ecf532db5 req-e35ee379-6167-42e4-9d21-48dd536e95f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b20de23a-a487-4289-9b7f-e82881619086", "name": "network-vif-deleted", "tag": "d03a940c-796d-4bb9-afaa-60957357f90f"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:55:36.102647 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-0b1bafb9-366e-49fc-81fd-ef7ecf532db5 req-e35ee379-6167-42e4-9d21-48dd536e95f1 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:36.103094 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-0b1bafb9-366e-49fc-81fd-ef7ecf532db5 req-e35ee379-6167-42e4-9d21-48dd536e95f1 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:36.114888 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-0b1bafb9-366e-49fc-81fd-ef7ecf532db5 req-e35ee379-6167-42e4-9d21-48dd536e95f1 service nova] Creating event network-vif-deleted:d03a940c-796d-4bb9-afaa-60957357f90f for instance b20de23a-a487-4289-9b7f-e82881619086 on hv-cinder-84130 May 10 17:55:36.121158 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-0b1bafb9-366e-49fc-81fd-ef7ecf532db5 req-e35ee379-6167-42e4-9d21-48dd536e95f1 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108147 May 10 17:55:36.125194 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 519/1026] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:55:36.565603 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bc5ecc8e-af79-4bf0-8e27-c6ccafe9a034 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:36.566363 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-bc5ecc8e-af79-4bf0-8e27-c6ccafe9a034 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:36.575255 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bc5ecc8e-af79-4bf0-8e27-c6ccafe9a034 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:36.575923 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bc5ecc8e-af79-4bf0-8e27-c6ccafe9a034 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:36.577117 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bc5ecc8e-af79-4bf0-8e27-c6ccafe9a034 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:36.577397 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bc5ecc8e-af79-4bf0-8e27-c6ccafe9a034 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:36.624305 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bc5ecc8e-af79-4bf0-8e27-c6ccafe9a034 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:36.624922 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bc5ecc8e-af79-4bf0-8e27-c6ccafe9a034 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:36.625640 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-bc5ecc8e-af79-4bf0-8e27-c6ccafe9a034 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lazy-loading 'fault' on Instance uuid b20de23a-a487-4289-9b7f-e82881619086 {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:55:36.674785 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-bc5ecc8e-af79-4bf0-8e27-c6ccafe9a034 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a99e5d684a48a2845d3379e7df812c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4e017a4040d450aad862065563ea64d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:55:36.683080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bc5ecc8e-af79-4bf0-8e27-c6ccafe9a034 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 200 len: 1330 microversion: 2.1 time: 0.124994 May 10 17:55:36.683685 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 508/1027] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:55:36 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 1330 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:55:37.702350 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2759a9bd-6ba6-47e1-84fe-5cdc429d21a0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:37.703056 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-2759a9bd-6ba6-47e1-84fe-5cdc429d21a0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:37.709346 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2759a9bd-6ba6-47e1-84fe-5cdc429d21a0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:37.709795 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2759a9bd-6ba6-47e1-84fe-5cdc429d21a0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:37.710563 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2759a9bd-6ba6-47e1-84fe-5cdc429d21a0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:37.711548 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2759a9bd-6ba6-47e1-84fe-5cdc429d21a0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:37.724856 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-2759a9bd-6ba6-47e1-84fe-5cdc429d21a0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] HTTP exception thrown: Instance b20de23a-a487-4289-9b7f-e82881619086 could not be found. May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2759a9bd-6ba6-47e1-84fe-5cdc429d21a0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Request method failure captured: May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 HTTP/1.1 May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqSO0xr7UIRxT3hXOmHxzovF69xIsGczVBDivdJOJBMJVORxiAfv56xQ3YabG87POPmQfFexgT58vToWwr1fhnRiMZA5-8wUr6OWagNr8GqdBYrkCpJLIa4vawh-qHLJ2BS3J-kASnH0YnEYJlsAV4sLiWMw7Cfpf3RSa_gKuZeEwB0 May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: f4e017a4040d450aad862065563ea64d May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:55:37.726606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:55:37.728778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4e017a4040d450aad862065563ea64d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4e017a4040d450aad862065563ea64d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}] May 10 17:55:37.728778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:37.728778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: f4e017a4040d450aad862065563ea64d May 10 17:55:37.728778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:37.728778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:55:37.728778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:55:37.728778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:55:37.728778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: e6a99e5d684a48a2845d3379e7df812c May 10 17:55:37.728778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:55:37.728778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:55:37.728778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance b20de23a-a487-4289-9b7f-e82881619086 could not be found. May 10 17:55:37.728778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': 'b20de23a-a487-4289-9b7f-e82881619086'} May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b20de23a-a487-4289-9b7f-e82881619086 could not be found. May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:55:37.729673 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:55:37.731312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:55:37.731312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:55:37.731312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:55:37.731312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:55:37.731312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:55:37.731312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:55:37.731312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:55:37.731312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b20de23a-a487-4289-9b7f-e82881619086 could not be found. May 10 17:55:37.731312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:37.731312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:37.731312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:37.731312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:37.731312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:37.731312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:37.731312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:55:37.731312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:55:37.731312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b20de23a-a487-4289-9b7f-e82881619086 could not be found. May 10 17:55:37.731312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:37.733206 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2759a9bd-6ba6-47e1-84fe-5cdc429d21a0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Returning 404 to user: Instance b20de23a-a487-4289-9b7f-e82881619086 could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:55:37.733206 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-2759a9bd-6ba6-47e1-84fe-5cdc429d21a0 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 404 len: 111 microversion: 2.1 time: 0.031216 May 10 17:55:37.733206 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 520/1028] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:55:37 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 17:55:37.737808 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ea8ca966-e1e7-45a0-88fc-c76fdf4d8d20 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '.version_select at 0x7f3e775a4040>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:37.755260 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ea8ca966-e1e7-45a0-88fc-c76fdf4d8d20 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-442766912" status: 202 len: 0 microversion: 2.1 time: 0.021289 May 10 17:55:37.755879 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 509/1029] 10.222.0.60 () {58 vars in 1217 bytes} [Tue May 10 17:55:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-442766912 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:55:39.519242 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c6aeacee-6fc7-4599-bdf6-46fd3e650a6f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:39.519854 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c6aeacee-6fc7-4599-bdf6-46fd3e650a6f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:39.526690 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c6aeacee-6fc7-4599-bdf6-46fd3e650a6f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:39.527138 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c6aeacee-6fc7-4599-bdf6-46fd3e650a6f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:39.527950 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c6aeacee-6fc7-4599-bdf6-46fd3e650a6f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:39.528387 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c6aeacee-6fc7-4599-bdf6-46fd3e650a6f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:39.543008 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-c6aeacee-6fc7-4599-bdf6-46fd3e650a6f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] HTTP exception thrown: Instance b20de23a-a487-4289-9b7f-e82881619086 could not be found. May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c6aeacee-6fc7-4599-bdf6-46fd3e650a6f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Request method failure captured: May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: DELETE /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 HTTP/1.1 May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqSO0xr7UIRxT3hXOmHxzovF69xIsGczVBDivdJOJBMJVORxiAfv56xQ3YabG87POPmQfFexgT58vToWwr1fhnRiMZA5-8wUr6OWagNr8GqdBYrkCpJLIa4vawh-qHLJ2BS3J-kASnH0YnEYJlsAV4sLiWMw7Cfpf3RSa_gKuZeEwB0 May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: f4e017a4040d450aad862065563ea64d May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:55:39.544758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:55:39.546396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4e017a4040d450aad862065563ea64d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4e017a4040d450aad862065563ea64d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}] May 10 17:55:39.546396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:39.546396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: f4e017a4040d450aad862065563ea64d May 10 17:55:39.546396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:39.546396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:55:39.546396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:55:39.546396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:55:39.546396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: e6a99e5d684a48a2845d3379e7df812c May 10 17:55:39.546396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:55:39.546396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:55:39.546396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance b20de23a-a487-4289-9b7f-e82881619086 could not be found. May 10 17:55:39.546396 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': 'b20de23a-a487-4289-9b7f-e82881619086'} May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b20de23a-a487-4289-9b7f-e82881619086 could not be found. May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:55:39.547231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b20de23a-a487-4289-9b7f-e82881619086 could not be found. May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b20de23a-a487-4289-9b7f-e82881619086 could not be found. May 10 17:55:39.548612 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:39.549912 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c6aeacee-6fc7-4599-bdf6-46fd3e650a6f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Returning 404 to user: Instance b20de23a-a487-4289-9b7f-e82881619086 could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:55:39.549912 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c6aeacee-6fc7-4599-bdf6-46fd3e650a6f tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 404 len: 111 microversion: 2.1 time: 0.030982 May 10 17:55:39.549912 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 521/1030] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:55:39 2022] DELETE /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:55:39.556631 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c45309cc-31d1-45f9-8e99-64830e3b45bc tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:39.557292 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c45309cc-31d1-45f9-8e99-64830e3b45bc tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: b20de23a-a487-4289-9b7f-e82881619086] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:39.563813 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c45309cc-31d1-45f9-8e99-64830e3b45bc tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:39.564328 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c45309cc-31d1-45f9-8e99-64830e3b45bc tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:39.565091 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c45309cc-31d1-45f9-8e99-64830e3b45bc tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:39.565541 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c45309cc-31d1-45f9-8e99-64830e3b45bc tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:39.579324 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-c45309cc-31d1-45f9-8e99-64830e3b45bc tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] HTTP exception thrown: Instance b20de23a-a487-4289-9b7f-e82881619086 could not be found. May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c45309cc-31d1-45f9-8e99-64830e3b45bc tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Request method failure captured: May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 HTTP/1.1 May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqSO0xr7UIRxT3hXOmHxzovF69xIsGczVBDivdJOJBMJVORxiAfv56xQ3YabG87POPmQfFexgT58vToWwr1fhnRiMZA5-8wUr6OWagNr8GqdBYrkCpJLIa4vawh-qHLJ2BS3J-kASnH0YnEYJlsAV4sLiWMw7Cfpf3RSa_gKuZeEwB0 May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: f4e017a4040d450aad862065563ea64d May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:55:39.581009 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:55:39.582515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4e017a4040d450aad862065563ea64d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4e017a4040d450aad862065563ea64d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}] May 10 17:55:39.582515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:39.582515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: f4e017a4040d450aad862065563ea64d May 10 17:55:39.582515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:39.582515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:55:39.582515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:55:39.582515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:55:39.582515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: e6a99e5d684a48a2845d3379e7df812c May 10 17:55:39.582515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:55:39.582515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:55:39.582515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance b20de23a-a487-4289-9b7f-e82881619086 could not be found. May 10 17:55:39.582515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': 'b20de23a-a487-4289-9b7f-e82881619086'} May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b20de23a-a487-4289-9b7f-e82881619086 could not be found. May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:55:39.583628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:55:39.585198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:55:39.585198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:55:39.585198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:55:39.585198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:55:39.585198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:55:39.585198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:55:39.585198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:55:39.585198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b20de23a-a487-4289-9b7f-e82881619086 could not be found. May 10 17:55:39.585198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:39.585198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:39.585198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:39.585198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:39.585198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:39.585198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:39.585198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:55:39.585198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:55:39.585198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b20de23a-a487-4289-9b7f-e82881619086 could not be found. May 10 17:55:39.585198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:39.587643 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c45309cc-31d1-45f9-8e99-64830e3b45bc tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Returning 404 to user: Instance b20de23a-a487-4289-9b7f-e82881619086 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:55:39.587643 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c45309cc-31d1-45f9-8e99-64830e3b45bc tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086" status: 404 len: 111 microversion: 2.1 time: 0.031073 May 10 17:55:39.587643 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 510/1031] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:55:39 2022] GET /compute/v2.1/servers/b20de23a-a487-4289-9b7f-e82881619086 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:55:40.722003 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9014e2c4-25a7-471e-b982-cfd29cb4d9be tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:40.722520 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-9014e2c4-25a7-471e-b982-cfd29cb4d9be tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:40.729124 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9014e2c4-25a7-471e-b982-cfd29cb4d9be tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:40.729576 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9014e2c4-25a7-471e-b982-cfd29cb4d9be tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:40.730349 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9014e2c4-25a7-471e-b982-cfd29cb4d9be tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:40.730788 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9014e2c4-25a7-471e-b982-cfd29cb4d9be tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:40.744921 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-9014e2c4-25a7-471e-b982-cfd29cb4d9be tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] HTTP exception thrown: Instance ed2618f3-4f12-48c9-888c-814f93d1fc49 could not be found. May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9014e2c4-25a7-471e-b982-cfd29cb4d9be tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Request method failure captured: May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: DELETE /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 HTTP/1.1 May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqSO0xr7UIRxT3hXOmHxzovF69xIsGczVBDivdJOJBMJVORxiAfv56xQ3YabG87POPmQfFexgT58vToWwr1fhnRiMZA5-8wUr6OWagNr8GqdBYrkCpJLIa4vawh-qHLJ2BS3J-kASnH0YnEYJlsAV4sLiWMw7Cfpf3RSa_gKuZeEwB0 May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: f4e017a4040d450aad862065563ea64d May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:55:40.746473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:55:40.748042 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4e017a4040d450aad862065563ea64d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4e017a4040d450aad862065563ea64d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}] May 10 17:55:40.748042 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:40.748042 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: f4e017a4040d450aad862065563ea64d May 10 17:55:40.748042 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:40.748042 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:55:40.748042 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:55:40.748042 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:55:40.748042 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: e6a99e5d684a48a2845d3379e7df812c May 10 17:55:40.748042 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:55:40.748042 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:55:40.748042 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance ed2618f3-4f12-48c9-888c-814f93d1fc49 could not be found. May 10 17:55:40.748042 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': 'ed2618f3-4f12-48c9-888c-814f93d1fc49'} May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed2618f3-4f12-48c9-888c-814f93d1fc49 could not be found. May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:55:40.748877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed2618f3-4f12-48c9-888c-814f93d1fc49 could not be found. May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed2618f3-4f12-48c9-888c-814f93d1fc49 could not be found. May 10 17:55:40.750055 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:40.751264 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9014e2c4-25a7-471e-b982-cfd29cb4d9be tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Returning 404 to user: Instance ed2618f3-4f12-48c9-888c-814f93d1fc49 could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:55:40.751264 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-9014e2c4-25a7-471e-b982-cfd29cb4d9be tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 404 len: 111 microversion: 2.1 time: 0.029770 May 10 17:55:40.751264 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 522/1032] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:55:40 2022] DELETE /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:55:40.756802 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-039c2cc0-7a8f-4f77-a130-3600da6da511 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:40.757421 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-039c2cc0-7a8f-4f77-a130-3600da6da511 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ed2618f3-4f12-48c9-888c-814f93d1fc49] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:40.764775 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-039c2cc0-7a8f-4f77-a130-3600da6da511 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:40.765245 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-039c2cc0-7a8f-4f77-a130-3600da6da511 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:40.766024 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-039c2cc0-7a8f-4f77-a130-3600da6da511 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:40.766465 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-039c2cc0-7a8f-4f77-a130-3600da6da511 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:40.779963 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-039c2cc0-7a8f-4f77-a130-3600da6da511 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] HTTP exception thrown: Instance ed2618f3-4f12-48c9-888c-814f93d1fc49 could not be found. May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-039c2cc0-7a8f-4f77-a130-3600da6da511 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Request method failure captured: May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 HTTP/1.1 May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqSO0xr7UIRxT3hXOmHxzovF69xIsGczVBDivdJOJBMJVORxiAfv56xQ3YabG87POPmQfFexgT58vToWwr1fhnRiMZA5-8wUr6OWagNr8GqdBYrkCpJLIa4vawh-qHLJ2BS3J-kASnH0YnEYJlsAV4sLiWMw7Cfpf3RSa_gKuZeEwB0 May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: f4e017a4040d450aad862065563ea64d May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:55:40.781505 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:55:40.783024 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4e017a4040d450aad862065563ea64d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4e017a4040d450aad862065563ea64d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}] May 10 17:55:40.783024 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:40.783024 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: f4e017a4040d450aad862065563ea64d May 10 17:55:40.783024 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:40.783024 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:55:40.783024 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:55:40.783024 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:55:40.783024 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: e6a99e5d684a48a2845d3379e7df812c May 10 17:55:40.783024 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:55:40.783024 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:55:40.783024 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance ed2618f3-4f12-48c9-888c-814f93d1fc49 could not be found. May 10 17:55:40.783024 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': 'ed2618f3-4f12-48c9-888c-814f93d1fc49'} May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed2618f3-4f12-48c9-888c-814f93d1fc49 could not be found. May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:55:40.783899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:55:40.785227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:55:40.785227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:55:40.785227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:55:40.785227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:55:40.785227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:55:40.785227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:55:40.785227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:55:40.785227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed2618f3-4f12-48c9-888c-814f93d1fc49 could not be found. May 10 17:55:40.785227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:40.785227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:40.785227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:40.785227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:40.785227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:40.785227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:40.785227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:55:40.785227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:55:40.785227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed2618f3-4f12-48c9-888c-814f93d1fc49 could not be found. May 10 17:55:40.785227 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:40.786540 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-039c2cc0-7a8f-4f77-a130-3600da6da511 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Returning 404 to user: Instance ed2618f3-4f12-48c9-888c-814f93d1fc49 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:55:40.786540 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-039c2cc0-7a8f-4f77-a130-3600da6da511 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49" status: 404 len: 111 microversion: 2.1 time: 0.029997 May 10 17:55:40.786540 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 511/1033] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:55:40 2022] GET /compute/v2.1/servers/ed2618f3-4f12-48c9-888c-814f93d1fc49 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:55:40.791744 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c6b9edb0-24e6-43ff-bbc3-d62e565ea130 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:40.792242 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c6b9edb0-24e6-43ff-bbc3-d62e565ea130 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:40.798227 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c6b9edb0-24e6-43ff-bbc3-d62e565ea130 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:40.798677 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c6b9edb0-24e6-43ff-bbc3-d62e565ea130 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:40.799462 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c6b9edb0-24e6-43ff-bbc3-d62e565ea130 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:40.799899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c6b9edb0-24e6-43ff-bbc3-d62e565ea130 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:40.817023 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-c6b9edb0-24e6-43ff-bbc3-d62e565ea130 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] HTTP exception thrown: Instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 could not be found. May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c6b9edb0-24e6-43ff-bbc3-d62e565ea130 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Request method failure captured: May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: DELETE /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 HTTP/1.1 May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqSO0xr7UIRxT3hXOmHxzovF69xIsGczVBDivdJOJBMJVORxiAfv56xQ3YabG87POPmQfFexgT58vToWwr1fhnRiMZA5-8wUr6OWagNr8GqdBYrkCpJLIa4vawh-qHLJ2BS3J-kASnH0YnEYJlsAV4sLiWMw7Cfpf3RSa_gKuZeEwB0 May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: f4e017a4040d450aad862065563ea64d May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:55:40.818577 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:55:40.821166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4e017a4040d450aad862065563ea64d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4e017a4040d450aad862065563ea64d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}] May 10 17:55:40.821166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:40.821166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: f4e017a4040d450aad862065563ea64d May 10 17:55:40.821166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:40.821166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:55:40.821166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:55:40.821166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:55:40.821166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: e6a99e5d684a48a2845d3379e7df812c May 10 17:55:40.821166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:55:40.821166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:55:40.821166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 could not be found. May 10 17:55:40.821166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': 'ab2c473c-6e44-4cb5-8ddb-128a2061ae50'} May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 could not be found. May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:55:40.822697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 could not be found. May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 could not be found. May 10 17:55:40.824894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:40.826350 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c6b9edb0-24e6-43ff-bbc3-d62e565ea130 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Returning 404 to user: Instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:55:40.826350 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c6b9edb0-24e6-43ff-bbc3-d62e565ea130 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "DELETE /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 404 len: 111 microversion: 2.1 time: 0.032348 May 10 17:55:40.826350 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 523/1034] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:55:40 2022] DELETE /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:55:40.829503 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-36c93ccb-ba52-484c-af22-df25f9083695 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:40.830176 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-36c93ccb-ba52-484c-af22-df25f9083695 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: ab2c473c-6e44-4cb5-8ddb-128a2061ae50] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:40.836592 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-36c93ccb-ba52-484c-af22-df25f9083695 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:40.837144 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-36c93ccb-ba52-484c-af22-df25f9083695 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:40.838196 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-36c93ccb-ba52-484c-af22-df25f9083695 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:40.838368 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-36c93ccb-ba52-484c-af22-df25f9083695 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:40.852428 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-36c93ccb-ba52-484c-af22-df25f9083695 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] HTTP exception thrown: Instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 could not be found. May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-36c93ccb-ba52-484c-af22-df25f9083695 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Request method failure captured: May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 HTTP/1.1 May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqSO0xr7UIRxT3hXOmHxzovF69xIsGczVBDivdJOJBMJVORxiAfv56xQ3YabG87POPmQfFexgT58vToWwr1fhnRiMZA5-8wUr6OWagNr8GqdBYrkCpJLIa4vawh-qHLJ2BS3J-kASnH0YnEYJlsAV4sLiWMw7Cfpf3RSa_gKuZeEwB0 May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: f4e017a4040d450aad862065563ea64d May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:55:40.853968 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:55:40.855585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4e017a4040d450aad862065563ea64d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4e017a4040d450aad862065563ea64d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}] May 10 17:55:40.855585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:40.855585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: f4e017a4040d450aad862065563ea64d May 10 17:55:40.855585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:40.855585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:55:40.855585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:55:40.855585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:55:40.855585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: e6a99e5d684a48a2845d3379e7df812c May 10 17:55:40.855585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:55:40.855585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:55:40.855585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 could not be found. May 10 17:55:40.855585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': 'ab2c473c-6e44-4cb5-8ddb-128a2061ae50'} May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 could not be found. May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:55:40.856475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:55:40.857960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:55:40.857960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:55:40.857960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:55:40.857960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:55:40.857960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:55:40.857960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:55:40.857960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:55:40.857960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 could not be found. May 10 17:55:40.857960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:40.857960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:40.857960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:40.857960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:40.857960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:40.857960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:40.857960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:55:40.857960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:55:40.857960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 could not be found. May 10 17:55:40.857960 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:40.859188 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-36c93ccb-ba52-484c-af22-df25f9083695 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Returning 404 to user: Instance ab2c473c-6e44-4cb5-8ddb-128a2061ae50 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:55:40.859188 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-36c93ccb-ba52-484c-af22-df25f9083695 tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50" status: 404 len: 111 microversion: 2.1 time: 0.029904 May 10 17:55:40.859188 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 512/1035] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:55:40 2022] GET /compute/v2.1/servers/ab2c473c-6e44-4cb5-8ddb-128a2061ae50 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 17:55:41.998699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7c47763d-b7c0-4a56-94ed-98c7a275953e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:41.999190 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7c47763d-b7c0-4a56-94ed-98c7a275953e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:42.005505 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7c47763d-b7c0-4a56-94ed-98c7a275953e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:42.005952 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7c47763d-b7c0-4a56-94ed-98c7a275953e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:42.006712 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7c47763d-b7c0-4a56-94ed-98c7a275953e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:42.007149 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7c47763d-b7c0-4a56-94ed-98c7a275953e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:42.020738 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-7c47763d-b7c0-4a56-94ed-98c7a275953e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] HTTP exception thrown: Instance 35dc394b-a596-4f36-89cf-f60e42d697d1 could not be found. May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7c47763d-b7c0-4a56-94ed-98c7a275953e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Request method failure captured: May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: DELETE /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 HTTP/1.1 May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqSO0xr7UIRxT3hXOmHxzovF69xIsGczVBDivdJOJBMJVORxiAfv56xQ3YabG87POPmQfFexgT58vToWwr1fhnRiMZA5-8wUr6OWagNr8GqdBYrkCpJLIa4vawh-qHLJ2BS3J-kASnH0YnEYJlsAV4sLiWMw7Cfpf3RSa_gKuZeEwB0 May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: f4e017a4040d450aad862065563ea64d May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:55:42.022215 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:55:42.024616 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4e017a4040d450aad862065563ea64d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4e017a4040d450aad862065563ea64d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}] May 10 17:55:42.024616 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:42.024616 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: f4e017a4040d450aad862065563ea64d May 10 17:55:42.024616 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:42.024616 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:55:42.024616 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:55:42.024616 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:55:42.024616 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: e6a99e5d684a48a2845d3379e7df812c May 10 17:55:42.024616 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:55:42.024616 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:55:42.024616 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance 35dc394b-a596-4f36-89cf-f60e42d697d1 could not be found. May 10 17:55:42.024616 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': '35dc394b-a596-4f36-89cf-f60e42d697d1'} May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35dc394b-a596-4f36-89cf-f60e42d697d1 could not be found. May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:55:42.025561 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35dc394b-a596-4f36-89cf-f60e42d697d1 could not be found. May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35dc394b-a596-4f36-89cf-f60e42d697d1 could not be found. May 10 17:55:42.027230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:42.028840 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7c47763d-b7c0-4a56-94ed-98c7a275953e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Returning 404 to user: Instance 35dc394b-a596-4f36-89cf-f60e42d697d1 could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:55:42.028840 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7c47763d-b7c0-4a56-94ed-98c7a275953e tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "DELETE /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 404 len: 111 microversion: 2.1 time: 0.028614 May 10 17:55:42.028840 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 524/1036] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:55:41 2022] DELETE /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:55:42.032993 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4112d661-d4cc-46f2-b8ed-96c658f7efdb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:42.033600 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-4112d661-d4cc-46f2-b8ed-96c658f7efdb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] [instance: 35dc394b-a596-4f36-89cf-f60e42d697d1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:42.040928 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4112d661-d4cc-46f2-b8ed-96c658f7efdb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:42.041366 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4112d661-d4cc-46f2-b8ed-96c658f7efdb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:42.042133 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4112d661-d4cc-46f2-b8ed-96c658f7efdb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:42.042568 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-4112d661-d4cc-46f2-b8ed-96c658f7efdb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:42.065951 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-4112d661-d4cc-46f2-b8ed-96c658f7efdb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] HTTP exception thrown: Instance 35dc394b-a596-4f36-89cf-f60e42d697d1 could not be found. May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4112d661-d4cc-46f2-b8ed-96c658f7efdb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Request method failure captured: May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 HTTP/1.1 May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqSO0xr7UIRxT3hXOmHxzovF69xIsGczVBDivdJOJBMJVORxiAfv56xQ3YabG87POPmQfFexgT58vToWwr1fhnRiMZA5-8wUr6OWagNr8GqdBYrkCpJLIa4vawh-qHLJ2BS3J-kASnH0YnEYJlsAV4sLiWMw7Cfpf3RSa_gKuZeEwB0 May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: f4e017a4040d450aad862065563ea64d May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:55:42.067533 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:55:42.069156 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/f4e017a4040d450aad862065563ea64d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_f4e017a4040d450aad862065563ea64d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/f4e017a4040d450aad862065563ea64d"}]}] May 10 17:55:42.069156 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:42.069156 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: f4e017a4040d450aad862065563ea64d May 10 17:55:42.069156 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-101320951 May 10 17:55:42.069156 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:55:42.069156 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:55:42.069156 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:55:42.069156 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: e6a99e5d684a48a2845d3379e7df812c May 10 17:55:42.069156 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeNegativeTest-101320951-project May 10 17:55:42.069156 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:55:42.069156 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance 35dc394b-a596-4f36-89cf-f60e42d697d1 could not be found. May 10 17:55:42.069156 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': '35dc394b-a596-4f36-89cf-f60e42d697d1'} May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35dc394b-a596-4f36-89cf-f60e42d697d1 could not be found. May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:55:42.070113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:55:42.071765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:55:42.071765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:55:42.071765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:55:42.071765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:55:42.071765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:55:42.071765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:55:42.071765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:55:42.071765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35dc394b-a596-4f36-89cf-f60e42d697d1 could not be found. May 10 17:55:42.071765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:42.071765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:42.071765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:42.071765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:42.071765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:42.071765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:42.071765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:55:42.071765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:55:42.071765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35dc394b-a596-4f36-89cf-f60e42d697d1 could not be found. May 10 17:55:42.071765 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:42.073177 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4112d661-d4cc-46f2-b8ed-96c658f7efdb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] Returning 404 to user: Instance 35dc394b-a596-4f36-89cf-f60e42d697d1 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:55:42.073177 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4112d661-d4cc-46f2-b8ed-96c658f7efdb tempest-AttachVolumeNegativeTest-101320951 tempest-AttachVolumeNegativeTest-101320951-project] 10.222.0.60 "GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1" status: 404 len: 111 microversion: 2.1 time: 0.039800 May 10 17:55:42.073177 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 513/1037] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:55:42 2022] GET /compute/v2.1/servers/35dc394b-a596-4f36-89cf-f60e42d697d1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 17:55:47.814426 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9cea4632-fe0a-473f-b59f-64e2ae0189f9 tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] Calling method '.version_select at 0x7f3e7ba3daf0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:47.867789 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-9cea4632-fe0a-473f-b59f-64e2ae0189f9 tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/569668db-b81e-4276-a418-a5081f6c196b" status: 200 len: 351 microversion: 2.1 time: 0.056429 May 10 17:55:47.868337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 525/1038] 10.222.0.60 () {58 vars in 1244 bytes} [Tue May 10 17:55:47 2022] GET /compute/v2.1/os-volumes/569668db-b81e-4276-a418-a5081f6c196b => generated 351 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:55:49.176701 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-050ef9b5-782c-4320-9f70-d8e3aec0f654 tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] Calling method '.version_select at 0x7f3e775a4e50>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:49.223849 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-050ef9b5-782c-4320-9f70-d8e3aec0f654 tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/97a12c74-438d-4d5b-b783-dabdb32efcc4" status: 200 len: 351 microversion: 2.1 time: 0.050826 May 10 17:55:49.224455 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 514/1039] 10.222.0.60 () {58 vars in 1244 bytes} [Tue May 10 17:55:49 2022] GET /compute/v2.1/os-volumes/97a12c74-438d-4d5b-b783-dabdb32efcc4 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:55:50.535250 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-881c0ed7-d2c7-4fe3-8078-23ee99d8a10b tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] Calling method '.version_select at 0x7f3e7b9cbca0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:50.580692 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-881c0ed7-d2c7-4fe3-8078-23ee99d8a10b tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/e551c22e-95f7-47f4-84ca-2f06cf692e43" status: 200 len: 351 microversion: 2.1 time: 0.049592 May 10 17:55:50.581257 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 526/1040] 10.222.0.60 () {58 vars in 1244 bytes} [Tue May 10 17:55:50 2022] GET /compute/v2.1/os-volumes/e551c22e-95f7-47f4-84ca-2f06cf692e43 => generated 351 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:55:50.593427 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-1d5a4156-7753-498b-abf3-a49b5e2fd6c2 tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] Calling method '.version_select at 0x7f3e76a564c0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:50.674867 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-1d5a4156-7753-498b-abf3-a49b5e2fd6c2 tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.085653 May 10 17:55:50.675465 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 515/1041] 10.222.0.60 () {58 vars in 1133 bytes} [Tue May 10 17:55:50 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:55:50.688177 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ba35f0ec-833b-4dff-8736-78b3a86520c8 tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] Calling method '.version_select at 0x7f3e7b9870d0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:50.768141 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ba35f0ec-833b-4dff-8736-78b3a86520c8 tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.083652 May 10 17:55:50.768718 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 527/1042] 10.222.0.60 () {58 vars in 1148 bytes} [Tue May 10 17:55:50 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:55:50.781433 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-42c3b8b8-6009-4377-b637-e843633cc122 tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] Calling method '.version_select at 0x7f3e7699c3a0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:50.860479 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-42c3b8b8-6009-4377-b637-e843633cc122 tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.082783 May 10 17:55:50.861045 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 516/1043] 10.222.0.60 () {58 vars in 1133 bytes} [Tue May 10 17:55:50 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:55:50.872742 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-0c3ee61a-949a-438b-a306-5ced55d65aca tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] Calling method '.version_select at 0x7f3e7b9fb4c0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:50.953198 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-0c3ee61a-949a-438b-a306-5ced55d65aca tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084142 May 10 17:55:50.953773 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 528/1044] 10.222.0.60 () {58 vars in 1166 bytes} [Tue May 10 17:55:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:55:50.965705 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b9af8d64-a435-455a-9c2c-3229fe776b5f tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] Calling method '.version_select at 0x7f3e76a569d0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:51.045158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b9af8d64-a435-455a-9c2c-3229fe776b5f tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.083116 May 10 17:55:51.045736 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 517/1045] 10.222.0.60 () {58 vars in 1169 bytes} [Tue May 10 17:55:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:55:51.057450 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b771e2eb-e54d-4e35-9b3e-251a3a8d9a33 tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] Calling method '.version_select at 0x7f3e7b99aca0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:51.136512 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b771e2eb-e54d-4e35-9b3e-251a3a8d9a33 tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.082738 May 10 17:55:51.137084 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 529/1046] 10.222.0.60 () {58 vars in 1154 bytes} [Tue May 10 17:55:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:55:51.147926 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bd87d988-abe5-47f7-8cdb-11e88913c04f tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] Calling method '.version_select at 0x7f3e76a24ca0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:51.227838 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bd87d988-abe5-47f7-8cdb-11e88913c04f tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083528 May 10 17:55:51.228421 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 518/1047] 10.222.0.60 () {58 vars in 1187 bytes} [Tue May 10 17:55:51 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:55:51.239748 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-57bade10-6623-4a42-91c8-22cf6309e740 tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] Calling method '.version_select at 0x7f3e7b9875e0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:51.320428 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-57bade10-6623-4a42-91c8-22cf6309e740 tempest-VolumesTestJSON-317396187 tempest-VolumesTestJSON-317396187-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.083860 May 10 17:55:51.321028 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 530/1048] 10.222.0.60 () {58 vars in 1154 bytes} [Tue May 10 17:55:51 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:55:55.472206 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6da256b2-a123-423f-b0b7-c543746c1997 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:55.473734 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6da256b2-a123-423f-b0b7-c543746c1997 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:55.481965 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6da256b2-a123-423f-b0b7-c543746c1997 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:55.482544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6da256b2-a123-423f-b0b7-c543746c1997 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:55.483655 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6da256b2-a123-423f-b0b7-c543746c1997 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:55.484394 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6da256b2-a123-423f-b0b7-c543746c1997 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:55.520231 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6da256b2-a123-423f-b0b7-c543746c1997 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052805 May 10 17:55:55.520812 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 519/1049] 10.222.0.60 () {60 vars in 1342 bytes} [Tue May 10 17:55:55 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:55:55.587306 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-68e53638-2744-4597-8d21-c0f5dabd75e6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:55.587868 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-68e53638-2744-4597-8d21-c0f5dabd75e6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:55.594634 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-68e53638-2744-4597-8d21-c0f5dabd75e6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:55.595092 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-68e53638-2744-4597-8d21-c0f5dabd75e6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:55.595930 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-68e53638-2744-4597-8d21-c0f5dabd75e6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:55.596373 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-68e53638-2744-4597-8d21-c0f5dabd75e6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:55.628681 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-68e53638-2744-4597-8d21-c0f5dabd75e6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Going to try to terminate instance {{(pid=123753) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:55:55.715935 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-68e53638-2744-4597-8d21-c0f5dabd75e6 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 204 len: 0 microversion: 2.20 time: 0.132785 May 10 17:55:55.716625 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 531/1050] 10.222.0.60 () {60 vars in 1279 bytes} [Tue May 10 17:55:55 2022] DELETE /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 17:55:55.727473 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-55f4a7b1-a971-438d-92d5-89211b0253bc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:55.728062 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-55f4a7b1-a971-438d-92d5-89211b0253bc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:55.734333 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55f4a7b1-a971-438d-92d5-89211b0253bc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:55.734784 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55f4a7b1-a971-438d-92d5-89211b0253bc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:55.735599 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55f4a7b1-a971-438d-92d5-89211b0253bc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:55.736043 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-55f4a7b1-a971-438d-92d5-89211b0253bc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:55.895250 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-55f4a7b1-a971-438d-92d5-89211b0253bc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:55:55.905262 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-55f4a7b1-a971-438d-92d5-89211b0253bc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:55:55.906776 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-55f4a7b1-a971-438d-92d5-89211b0253bc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:55:55.908003 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-55f4a7b1-a971-438d-92d5-89211b0253bc tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1722 microversion: 2.20 time: 0.186790 May 10 17:55:55.908802 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 520/1051] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:55:55 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:55:56.214105 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-636312e7-538d-4bfa-8471-cfc16ee0ba39 tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] Action: 'create', calling method: .version_select at 0x7f3e7bab98b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1554710983", "metadata": {"Type": "work"}}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-636312e7-538d-4bfa-8471-cfc16ee0ba39 tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] Request method failure captured: May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 122 May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqcs-4bwWBxeqR9mOWpvpShX1KmsLTYPqhvo5_M3aUkaKsPh-iB1Hsa0tL6Zpm3vt7S87wuvrNDZqdzDQ1k7fPx4Pv3MIqqa1CAHv3hec1u9wLgbiBf5nE3qZuoxtHzb5ISA8dmTAoQS2aZCRVYrYw4nd7TaCcnqa15sWeBXhAiJMz0 May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: cbea2d93b2c741ad983e4085230f9fde May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-VolumesNegativeTest-787422404 May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:55:56.240417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:55:56.242619 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbea2d93b2c741ad983e4085230f9fde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cbea2d93b2c741ad983e4085230f9fde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cbea2d93b2c741ad983e4085230f9fde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbea2d93b2c741ad983e4085230f9fde"}]}] May 10 17:55:56.242619 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-VolumesNegativeTest-787422404 May 10 17:55:56.242619 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: cbea2d93b2c741ad983e4085230f9fde May 10 17:55:56.242619 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-VolumesNegativeTest-787422404 May 10 17:55:56.242619 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-VolumesNegativeTest-787422404-project May 10 17:55:56.242619 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:55:56.242619 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:55:56.242619 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: 99acce603eb64c22bf98b32501090bc3 May 10 17:55:56.242619 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-VolumesNegativeTest-787422404-project May 10 17:55:56.242619 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: May 10 17:55:56.242619 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1554710983", "metadata": {"Type": "work"}}} May 10 17:55:56.242619 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: May 10 17:55:56.242619 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1554710983', 'metadata': {'Type': 'work'}}}} May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise error May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi '#$%' May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:55:56.243848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:55:56.245508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 17:55:56.245508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 17:55:56.245508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:55:56.245508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:55:56.245508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 17:55:56.245508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 17:55:56.245508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 17:55:56.245508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 17:55:56.245508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 17:55:56.245508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 17:55:56.245508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 17:55:56.245508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.245508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:56.245508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.245508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.245508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:56.245508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:56.245508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 17:55:56.245508 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 17:55:56.247273 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 10 17:55:56.247273 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.247273 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-636312e7-538d-4bfa-8471-cfc16ee0ba39 tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:55:56.247273 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-636312e7-538d-4bfa-8471-cfc16ee0ba39 tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.138858 May 10 17:55:56.247273 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 532/1052] 10.222.0.60 () {60 vars in 1155 bytes} [Tue May 10 17:55:56 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 141 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 17:55:56.252185 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f1e65a5a-8757-435e-b2fc-782459de60ba tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] Action: 'create', calling method: .version_select at 0x7f3e76996a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1506975295", "metadata": {"Type": "work"}}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f1e65a5a-8757-435e-b2fc-782459de60ba tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] Request method failure captured: May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 120 May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqcs-4bwWBxeqR9mOWpvpShX1KmsLTYPqhvo5_M3aUkaKsPh-iB1Hsa0tL6Zpm3vt7S87wuvrNDZqdzDQ1k7fPx4Pv3MIqqa1CAHv3hec1u9wLgbiBf5nE3qZuoxtHzb5ISA8dmTAoQS2aZCRVYrYw4nd7TaCcnqa15sWeBXhAiJMz0 May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: cbea2d93b2c741ad983e4085230f9fde May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-VolumesNegativeTest-787422404 May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:55:56.255384 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:55:56.256924 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbea2d93b2c741ad983e4085230f9fde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cbea2d93b2c741ad983e4085230f9fde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cbea2d93b2c741ad983e4085230f9fde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbea2d93b2c741ad983e4085230f9fde"}]}] May 10 17:55:56.256924 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-VolumesNegativeTest-787422404 May 10 17:55:56.256924 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: cbea2d93b2c741ad983e4085230f9fde May 10 17:55:56.256924 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-VolumesNegativeTest-787422404 May 10 17:55:56.256924 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-VolumesNegativeTest-787422404-project May 10 17:55:56.256924 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:55:56.256924 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:55:56.256924 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: 99acce603eb64c22bf98b32501090bc3 May 10 17:55:56.256924 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-VolumesNegativeTest-787422404-project May 10 17:55:56.256924 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: May 10 17:55:56.256924 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1506975295", "metadata": {"Type": "work"}}} May 10 17:55:56.256924 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: May 10 17:55:56.256924 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1506975295', 'metadata': {'Type': 'work'}}}} May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise error May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi '0' May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:55:56.258863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:55:56.260341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 17:55:56.260341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 17:55:56.260341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:55:56.260341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:55:56.260341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 17:55:56.260341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 17:55:56.260341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 17:55:56.260341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 17:55:56.260341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 17:55:56.260341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 17:55:56.260341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 17:55:56.260341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.260341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:56.260341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.260341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.260341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:56.260341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:56.260341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 17:55:56.260341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 17:55:56.261481 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 10 17:55:56.261481 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.261481 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f1e65a5a-8757-435e-b2fc-782459de60ba tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:55:56.261481 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f1e65a5a-8757-435e-b2fc-782459de60ba tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008598 May 10 17:55:56.261481 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 521/1053] 10.222.0.60 () {60 vars in 1155 bytes} [Tue May 10 17:55:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 17:55:56.267415 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1d346cc5-7964-4951-b9cc-c77cb207feca tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] Action: 'create', calling method: .version_select at 0x7f3e7ba0c0d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-230815634", "metadata": {"Type": "work"}}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1d346cc5-7964-4951-b9cc-c77cb207feca tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] Request method failure captured: May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 118 May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqcs-4bwWBxeqR9mOWpvpShX1KmsLTYPqhvo5_M3aUkaKsPh-iB1Hsa0tL6Zpm3vt7S87wuvrNDZqdzDQ1k7fPx4Pv3MIqqa1CAHv3hec1u9wLgbiBf5nE3qZuoxtHzb5ISA8dmTAoQS2aZCRVYrYw4nd7TaCcnqa15sWeBXhAiJMz0 May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: cbea2d93b2c741ad983e4085230f9fde May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-VolumesNegativeTest-787422404 May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:55:56.270572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:55:56.272189 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbea2d93b2c741ad983e4085230f9fde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cbea2d93b2c741ad983e4085230f9fde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cbea2d93b2c741ad983e4085230f9fde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbea2d93b2c741ad983e4085230f9fde"}]}] May 10 17:55:56.272189 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-VolumesNegativeTest-787422404 May 10 17:55:56.272189 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: cbea2d93b2c741ad983e4085230f9fde May 10 17:55:56.272189 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-VolumesNegativeTest-787422404 May 10 17:55:56.272189 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-VolumesNegativeTest-787422404-project May 10 17:55:56.272189 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:55:56.272189 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:55:56.272189 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: 99acce603eb64c22bf98b32501090bc3 May 10 17:55:56.272189 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-VolumesNegativeTest-787422404-project May 10 17:55:56.272189 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: May 10 17:55:56.272189 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-230815634", "metadata": {"Type": "work"}}} May 10 17:55:56.272189 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: May 10 17:55:56.272189 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-230815634', 'metadata': {'Type': 'work'}}}} May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise error May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi On instance['volume']: May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi '' May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:55:56.273779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:55:56.275348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 17:55:56.275348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 17:55:56.275348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:55:56.275348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:55:56.275348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 10 17:55:56.275348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 10 17:55:56.275348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 10 17:55:56.275348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 10 17:55:56.275348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 10 17:55:56.275348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 10 17:55:56.275348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 17:55:56.275348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.275348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:56.275348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.275348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.275348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:56.275348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:56.275348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 10 17:55:56.275348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 10 17:55:56.276991 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 10 17:55:56.276991 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.276991 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1d346cc5-7964-4951-b9cc-c77cb207feca tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:55:56.276991 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-1d346cc5-7964-4951-b9cc-c77cb207feca tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008436 May 10 17:55:56.276991 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 533/1054] 10.222.0.60 () {60 vars in 1155 bytes} [Tue May 10 17:55:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 10 17:55:56.281230 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7e336329-950d-4d25-bbff-102617631e6d tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] Calling method '.version_select at 0x7f3e76a02a60>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:56.309632 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-7e336329-950d-4d25-bbff-102617631e6d tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] HTTP exception thrown: Volume tempest-invalid-741077669 could not be found. May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7e336329-950d-4d25-bbff-102617631e6d tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] Request method failure captured: May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-741077669 HTTP/1.1 May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqcs-4bwWBxeqR9mOWpvpShX1KmsLTYPqhvo5_M3aUkaKsPh-iB1Hsa0tL6Zpm3vt7S87wuvrNDZqdzDQ1k7fPx4Pv3MIqqa1CAHv3hec1u9wLgbiBf5nE3qZuoxtHzb5ISA8dmTAoQS2aZCRVYrYw4nd7TaCcnqa15sWeBXhAiJMz0 May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: cbea2d93b2c741ad983e4085230f9fde May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-VolumesNegativeTest-787422404 May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:55:56.312818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:55:56.314373 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbea2d93b2c741ad983e4085230f9fde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cbea2d93b2c741ad983e4085230f9fde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cbea2d93b2c741ad983e4085230f9fde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbea2d93b2c741ad983e4085230f9fde"}]}] May 10 17:55:56.314373 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-VolumesNegativeTest-787422404 May 10 17:55:56.314373 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: cbea2d93b2c741ad983e4085230f9fde May 10 17:55:56.314373 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-VolumesNegativeTest-787422404 May 10 17:55:56.314373 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-VolumesNegativeTest-787422404-project May 10 17:55:56.314373 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:55:56.314373 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:55:56.314373 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: 99acce603eb64c22bf98b32501090bc3 May 10 17:55:56.314373 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-VolumesNegativeTest-787422404-project May 10 17:55:56.314373 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: May 10 17:55:56.314373 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Volume tempest-invalid-741077669 could not be found. May 10 17:55:56.314373 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': 'tempest-invalid-741077669'} May 10 17:55:56.314373 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:55:56.315266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.315266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 17:55:56.315266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 17:55:56.315266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 17:55:56.315266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 17:55:56.315266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 17:55:56.315266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 17:55:56.315266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 17:55:56.315266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 17:55:56.315266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 17:55:56.315266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 17:55:56.315266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 17:55:56.315266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 17:55:56.315266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 17:55:56.315266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 17:55:56.315266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-741077669 could not be found. (HTTP 404) (Request-ID: req-f75b0a45-4898-47cb-8b72-1f3a8ae6444d) May 10 17:55:56.315266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.315266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:56.315266 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.316543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.316543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 17:55:56.316543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 17:55:56.316543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 17:55:56.316543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 17:55:56.316543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 17:55:56.316543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 17:55:56.316543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 17:55:56.316543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 17:55:56.316543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 17:55:56.316543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 17:55:56.316543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 17:55:56.316543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 17:55:56.316543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 17:55:56.316543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 17:55:56.316543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 17:55:56.316543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 17:55:56.316543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 17:55:56.316543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-741077669 could not be found. May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:55:56.317846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-741077669 could not be found. May 10 17:55:56.319287 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.319287 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:56.319287 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.319287 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.319287 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:56.319287 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:56.319287 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:55:56.319287 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:55:56.319287 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-741077669 could not be found. May 10 17:55:56.319287 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.319287 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-7e336329-950d-4d25-bbff-102617631e6d tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] Returning 404 to user: Volume tempest-invalid-741077669 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:55:56.319287 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-7e336329-950d-4d25-bbff-102617631e6d tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/tempest-invalid-741077669" status: 404 len: 98 microversion: 2.1 time: 0.036793 May 10 17:55:56.319287 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 522/1055] 10.222.0.60 () {58 vars in 1214 bytes} [Tue May 10 17:55:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-741077669 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 10 17:55:56.325880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-56a24323-4a59-460a-9ca1-7b0eafdc3f84 tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004113 May 10 17:55:56.326403 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 534/1056] 10.222.0.60 () {58 vars in 1139 bytes} [Tue May 10 17:55:56 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 17:55:56.336468 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f27c4f40-49ad-4a90-accb-4dd09a863ed8 tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004268 May 10 17:55:56.337359 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 523/1057] 10.222.0.60 () {58 vars in 1136 bytes} [Tue May 10 17:55:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 10 17:55:56.346337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fb7c3e0b-e3cc-4aad-badd-cfa6251d3758 tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] Calling method '.version_select at 0x7f3e7b987af0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:56.373473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-fb7c3e0b-e3cc-4aad-badd-cfa6251d3758 tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] HTTP exception thrown: Volume 942c6732-d8dc-43e0-9d9a-54f0a12b99d1 could not be found. May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fb7c3e0b-e3cc-4aad-badd-cfa6251d3758 tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] Request method failure captured: May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: DELETE /compute/v2.1/os-volumes/942c6732-d8dc-43e0-9d9a-54f0a12b99d1 HTTP/1.1 May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqcs-4bwWBxeqR9mOWpvpShX1KmsLTYPqhvo5_M3aUkaKsPh-iB1Hsa0tL6Zpm3vt7S87wuvrNDZqdzDQ1k7fPx4Pv3MIqqa1CAHv3hec1u9wLgbiBf5nE3qZuoxtHzb5ISA8dmTAoQS2aZCRVYrYw4nd7TaCcnqa15sWeBXhAiJMz0 May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: cbea2d93b2c741ad983e4085230f9fde May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-VolumesNegativeTest-787422404 May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:55:56.375485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:55:56.377032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbea2d93b2c741ad983e4085230f9fde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cbea2d93b2c741ad983e4085230f9fde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cbea2d93b2c741ad983e4085230f9fde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbea2d93b2c741ad983e4085230f9fde"}]}] May 10 17:55:56.377032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-VolumesNegativeTest-787422404 May 10 17:55:56.377032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: cbea2d93b2c741ad983e4085230f9fde May 10 17:55:56.377032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-VolumesNegativeTest-787422404 May 10 17:55:56.377032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-VolumesNegativeTest-787422404-project May 10 17:55:56.377032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:55:56.377032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:55:56.377032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: 99acce603eb64c22bf98b32501090bc3 May 10 17:55:56.377032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-VolumesNegativeTest-787422404-project May 10 17:55:56.377032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: May 10 17:55:56.377032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Volume 942c6732-d8dc-43e0-9d9a-54f0a12b99d1 could not be found. May 10 17:55:56.377032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': '942c6732-d8dc-43e0-9d9a-54f0a12b99d1'} May 10 17:55:56.377032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:55:56.377881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.377881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 17:55:56.377881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 17:55:56.377881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 17:55:56.377881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 17:55:56.377881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 17:55:56.377881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 17:55:56.377881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 17:55:56.377881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 17:55:56.377881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 17:55:56.377881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 17:55:56.377881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 17:55:56.377881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 17:55:56.377881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 17:55:56.377881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 17:55:56.377881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 942c6732-d8dc-43e0-9d9a-54f0a12b99d1 could not be found. (HTTP 404) (Request-ID: req-fd66a660-b421-4bab-a36a-de4295b51dc1) May 10 17:55:56.377881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.377881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:56.377881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.378990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.378990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 10 17:55:56.378990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 10 17:55:56.378990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 17:55:56.378990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 17:55:56.378990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 17:55:56.378990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 17:55:56.378990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 17:55:56.378990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 17:55:56.378990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 17:55:56.378990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 17:55:56.378990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 10 17:55:56.378990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 10 17:55:56.378990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 10 17:55:56.378990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 10 17:55:56.378990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 10 17:55:56.378990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 10 17:55:56.378990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 10 17:55:56.378990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 10 17:55:56.380135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 17:55:56.380135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 17:55:56.380135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 17:55:56.380135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 17:55:56.380135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 942c6732-d8dc-43e0-9d9a-54f0a12b99d1 could not be found. May 10 17:55:56.380135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.380135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:56.380135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.380135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.380135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:56.380135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:56.380135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:55:56.380135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:55:56.380135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 17:55:56.380135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 17:55:56.380135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:55:56.380135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:55:56.380135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 10 17:55:56.380135 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:55:56.381357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 942c6732-d8dc-43e0-9d9a-54f0a12b99d1 could not be found. May 10 17:55:56.381357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.381357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:56.381357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.381357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.381357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:56.381357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:56.381357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:55:56.381357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:55:56.381357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 942c6732-d8dc-43e0-9d9a-54f0a12b99d1 could not be found. May 10 17:55:56.381357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:55:56.381357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fb7c3e0b-e3cc-4aad-badd-cfa6251d3758 tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] Returning 404 to user: Volume 942c6732-d8dc-43e0-9d9a-54f0a12b99d1 could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:55:56.381357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-fb7c3e0b-e3cc-4aad-badd-cfa6251d3758 tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/942c6732-d8dc-43e0-9d9a-54f0a12b99d1" status: 404 len: 109 microversion: 2.1 time: 0.034402 May 10 17:55:56.381357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 535/1058] 10.222.0.60 () {58 vars in 1247 bytes} [Tue May 10 17:55:56 2022] DELETE /compute/v2.1/os-volumes/942c6732-d8dc-43e0-9d9a-54f0a12b99d1 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:55:56.387577 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4de64be3-f919-4a25-839c-7c1d042e7c6c tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] Calling method '.version_select at 0x7f3e767df4c0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:56.415745 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-4de64be3-f919-4a25-839c-7c1d042e7c6c tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] HTTP exception thrown: Volume bf0202ba-6b52-4a22-87cf-bad9ab8e1995 could not be found. May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4de64be3-f919-4a25-839c-7c1d042e7c6c tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] Request method failure captured: May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/os-volumes/bf0202ba-6b52-4a22-87cf-bad9ab8e1995 HTTP/1.1 May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqcs-4bwWBxeqR9mOWpvpShX1KmsLTYPqhvo5_M3aUkaKsPh-iB1Hsa0tL6Zpm3vt7S87wuvrNDZqdzDQ1k7fPx4Pv3MIqqa1CAHv3hec1u9wLgbiBf5nE3qZuoxtHzb5ISA8dmTAoQS2aZCRVYrYw4nd7TaCcnqa15sWeBXhAiJMz0 May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: cbea2d93b2c741ad983e4085230f9fde May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-VolumesNegativeTest-787422404 May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:55:56.417795 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:55:56.419354 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbea2d93b2c741ad983e4085230f9fde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/cbea2d93b2c741ad983e4085230f9fde"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_cbea2d93b2c741ad983e4085230f9fde"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/cbea2d93b2c741ad983e4085230f9fde"}]}] May 10 17:55:56.419354 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-VolumesNegativeTest-787422404 May 10 17:55:56.419354 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: cbea2d93b2c741ad983e4085230f9fde May 10 17:55:56.419354 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-VolumesNegativeTest-787422404 May 10 17:55:56.419354 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-VolumesNegativeTest-787422404-project May 10 17:55:56.419354 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:55:56.419354 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:55:56.419354 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: 99acce603eb64c22bf98b32501090bc3 May 10 17:55:56.419354 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-VolumesNegativeTest-787422404-project May 10 17:55:56.419354 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: May 10 17:55:56.419354 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Volume bf0202ba-6b52-4a22-87cf-bad9ab8e1995 could not be found. May 10 17:55:56.419354 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': 'bf0202ba-6b52-4a22-87cf-bad9ab8e1995'} May 10 17:55:56.419354 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:55:56.421402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.421402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 17:55:56.421402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 17:55:56.421402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 17:55:56.421402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 17:55:56.421402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 17:55:56.421402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 17:55:56.421402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 17:55:56.421402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 17:55:56.421402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 17:55:56.421402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 17:55:56.421402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 17:55:56.421402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 17:55:56.421402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 17:55:56.421402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 17:55:56.421402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bf0202ba-6b52-4a22-87cf-bad9ab8e1995 could not be found. (HTTP 404) (Request-ID: req-6beedf87-ffd5-4ffd-85da-e693e4d81022) May 10 17:55:56.421402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.421402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:56.421402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.422845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.422845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 17:55:56.422845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 17:55:56.422845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 17:55:56.422845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 17:55:56.422845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 17:55:56.422845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 17:55:56.422845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 17:55:56.422845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 17:55:56.422845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 17:55:56.422845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 17:55:56.422845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 17:55:56.422845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 17:55:56.422845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 17:55:56.422845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 17:55:56.422845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 17:55:56.422845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 17:55:56.422845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 17:55:56.422845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 17:55:56.424209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 17:55:56.424209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 17:55:56.424209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 17:55:56.424209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 17:55:56.424209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bf0202ba-6b52-4a22-87cf-bad9ab8e1995 could not be found. May 10 17:55:56.424209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.424209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:56.424209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.424209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.424209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:56.424209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:56.424209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:55:56.424209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:55:56.424209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 17:55:56.424209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 17:55:56.424209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:55:56.424209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:55:56.424209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 17:55:56.424209 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:55:56.425571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bf0202ba-6b52-4a22-87cf-bad9ab8e1995 could not be found. May 10 17:55:56.425571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.425571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:56.425571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.425571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:56.425571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:56.425571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:56.425571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:55:56.425571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:55:56.425571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bf0202ba-6b52-4a22-87cf-bad9ab8e1995 could not be found. May 10 17:55:56.425571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:56.425571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4de64be3-f919-4a25-839c-7c1d042e7c6c tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] Returning 404 to user: Volume bf0202ba-6b52-4a22-87cf-bad9ab8e1995 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:55:56.425571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4de64be3-f919-4a25-839c-7c1d042e7c6c tempest-VolumesNegativeTest-787422404 tempest-VolumesNegativeTest-787422404-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/bf0202ba-6b52-4a22-87cf-bad9ab8e1995" status: 404 len: 109 microversion: 2.1 time: 0.035623 May 10 17:55:56.425571 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 524/1059] 10.222.0.60 () {58 vars in 1244 bytes} [Tue May 10 17:55:56 2022] GET /compute/v2.1/os-volumes/bf0202ba-6b52-4a22-87cf-bad9ab8e1995 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:55:56.934060 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a2778fa3-7313-4f6e-a7a2-7e1455f8ad80 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:56.934847 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a2778fa3-7313-4f6e-a7a2-7e1455f8ad80 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:56.941737 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a2778fa3-7313-4f6e-a7a2-7e1455f8ad80 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:56.942210 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a2778fa3-7313-4f6e-a7a2-7e1455f8ad80 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:56.943001 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a2778fa3-7313-4f6e-a7a2-7e1455f8ad80 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:56.943466 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a2778fa3-7313-4f6e-a7a2-7e1455f8ad80 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:57.095211 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a2778fa3-7313-4f6e-a7a2-7e1455f8ad80 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:55:57.103389 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a2778fa3-7313-4f6e-a7a2-7e1455f8ad80 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:55:57.104893 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a2778fa3-7313-4f6e-a7a2-7e1455f8ad80 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:55:57.106054 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a2778fa3-7313-4f6e-a7a2-7e1455f8ad80 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1722 microversion: 2.20 time: 0.177465 May 10 17:55:57.106607 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 536/1060] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:55:56 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:55:58.124683 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c5163896-5291-4171-be79-a93b165e22cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:58.125134 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-c5163896-5291-4171-be79-a93b165e22cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:58.135816 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c5163896-5291-4171-be79-a93b165e22cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:58.136387 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c5163896-5291-4171-be79-a93b165e22cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:58.137323 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c5163896-5291-4171-be79-a93b165e22cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:58.137889 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-c5163896-5291-4171-be79-a93b165e22cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:58.233741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c5163896-5291-4171-be79-a93b165e22cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:55:58.242161 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c5163896-5291-4171-be79-a93b165e22cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:55:58.243964 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-c5163896-5291-4171-be79-a93b165e22cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ed37128b78a6454c9c387ad91995a05d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0461acfadf8743fdbd62a39bf3fe3e1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:55:58.245152 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c5163896-5291-4171-be79-a93b165e22cf tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 200 len: 1655 microversion: 2.20 time: 0.124694 May 10 17:55:58.245912 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 525/1061] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:55:58 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 1655 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 10 17:55:58.435995 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-1ee0f1be-647e-47a3-aa86-4a9872559c2e req-c05f5fa4-5d4b-4ef1-83ec-1574be0e94f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e16b7603-15a8-44a4-82c9-729bedfb8ac6", "name": "network-vif-deleted", "tag": "cb176284-f148-403c-b988-83b0bfbdd7dd"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:55:58.447017 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-1ee0f1be-647e-47a3-aa86-4a9872559c2e req-c05f5fa4-5d4b-4ef1-83ec-1574be0e94f8 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:58.447767 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-1ee0f1be-647e-47a3-aa86-4a9872559c2e req-c05f5fa4-5d4b-4ef1-83ec-1574be0e94f8 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:58.461651 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-1ee0f1be-647e-47a3-aa86-4a9872559c2e req-c05f5fa4-5d4b-4ef1-83ec-1574be0e94f8 service nova] Creating event network-vif-deleted:cb176284-f148-403c-b988-83b0bfbdd7dd for instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 on hv-cinder-84130 May 10 17:55:58.470951 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-1ee0f1be-647e-47a3-aa86-4a9872559c2e req-c05f5fa4-5d4b-4ef1-83ec-1574be0e94f8 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038535 May 10 17:55:58.471896 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 537/1062] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:55:59.265058 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ef39bcef-7e0e-45d4-a5c4-0a361ffdf99a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:59.265711 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ef39bcef-7e0e-45d4-a5c4-0a361ffdf99a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:55:59.272263 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef39bcef-7e0e-45d4-a5c4-0a361ffdf99a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:59.272732 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef39bcef-7e0e-45d4-a5c4-0a361ffdf99a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:59.273544 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef39bcef-7e0e-45d4-a5c4-0a361ffdf99a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:55:59.274030 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef39bcef-7e0e-45d4-a5c4-0a361ffdf99a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:55:59.289243 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-ef39bcef-7e0e-45d4-a5c4-0a361ffdf99a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] HTTP exception thrown: Instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 could not be found. May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ef39bcef-7e0e-45d4-a5c4-0a361ffdf99a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Request method failure captured: May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 HTTP/1.1 May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqSMD5zFR04x6JtjS3MbQUgk0VxFiC3AxAUwRqENdzti4WIBX6ZnMRlb9ahyqq6CXfmlXyunZRn50Sb3_IfgcUypC6NDEkZymbOczMSJO2_nFPa_MFyGFjrTS7PVQLqFgKYAlK1sQJBejX-hEE8hAdGyrLzNihPIdGkmPQwbDx3aW5Y May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Openstack-Nova-Api-Version: 2.20 May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: 0461acfadf8743fdbd62a39bf3fe3e1c May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-929324698 May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:55:59.291110 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:55:59.292797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0461acfadf8743fdbd62a39bf3fe3e1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0461acfadf8743fdbd62a39bf3fe3e1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0461acfadf8743fdbd62a39bf3fe3e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0461acfadf8743fdbd62a39bf3fe3e1c"}]}] May 10 17:55:59.292797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeShelveTestJSON-929324698 May 10 17:55:59.292797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 0461acfadf8743fdbd62a39bf3fe3e1c May 10 17:55:59.292797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-929324698 May 10 17:55:59.292797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeShelveTestJSON-929324698-project May 10 17:55:59.292797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:55:59.292797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:55:59.292797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: ed37128b78a6454c9c387ad91995a05d May 10 17:55:59.292797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeShelveTestJSON-929324698-project May 10 17:55:59.292797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:55:59.292797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 could not be found. May 10 17:55:59.292797 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': 'e16b7603-15a8-44a4-82c9-729bedfb8ac6'} May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 could not be found. May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:55:59.293704 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:55:59.295312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:55:59.295312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:55:59.295312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:55:59.295312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:55:59.295312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:55:59.295312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:55:59.295312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:55:59.295312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 could not be found. May 10 17:55:59.295312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:59.295312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:55:59.295312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:59.295312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:55:59.295312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:55:59.295312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:55:59.295312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:55:59.295312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:55:59.295312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 could not be found. May 10 17:55:59.295312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:55:59.301474 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ef39bcef-7e0e-45d4-a5c4-0a361ffdf99a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Returning 404 to user: Instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:55:59.302668 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ef39bcef-7e0e-45d4-a5c4-0a361ffdf99a tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 404 len: 111 microversion: 2.20 time: 0.041902 May 10 17:55:59.303430 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 526/1063] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:55:59 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 17:55:59.313950 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2db308a7-4511-4962-b0ce-41e6f47b2263 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '.version_select at 0x7f3e7b9ebdc0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:55:59.336223 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-2db308a7-4511-4962-b0ce-41e6f47b2263 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019081118" status: 204 len: 0 microversion: 2.20 time: 0.026696 May 10 17:55:59.337106 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 538/1064] 10.222.0.60 () {60 vars in 1261 bytes} [Tue May 10 17:55:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019081118 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 10 17:56:01.165972 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-663206a3-1cdc-4153-82f7-a85a4db093ca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:01.166510 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-663206a3-1cdc-4153-82f7-a85a4db093ca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:56:01.172888 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-663206a3-1cdc-4153-82f7-a85a4db093ca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:01.173345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-663206a3-1cdc-4153-82f7-a85a4db093ca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:01.174123 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-663206a3-1cdc-4153-82f7-a85a4db093ca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:01.174566 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-663206a3-1cdc-4153-82f7-a85a4db093ca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:01.189389 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-663206a3-1cdc-4153-82f7-a85a4db093ca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] HTTP exception thrown: Instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 could not be found. May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-663206a3-1cdc-4153-82f7-a85a4db093ca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Request method failure captured: May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: DELETE /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 HTTP/1.1 May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqSMD5zFR04x6JtjS3MbQUgk0VxFiC3AxAUwRqENdzti4WIBX6ZnMRlb9ahyqq6CXfmlXyunZRn50Sb3_IfgcUypC6NDEkZymbOczMSJO2_nFPa_MFyGFjrTS7PVQLqFgKYAlK1sQJBejX-hEE8hAdGyrLzNihPIdGkmPQwbDx3aW5Y May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Openstack-Nova-Api-Version: 2.20 May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: 0461acfadf8743fdbd62a39bf3fe3e1c May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-929324698 May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:56:01.190994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:56:01.192628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0461acfadf8743fdbd62a39bf3fe3e1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0461acfadf8743fdbd62a39bf3fe3e1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0461acfadf8743fdbd62a39bf3fe3e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0461acfadf8743fdbd62a39bf3fe3e1c"}]}] May 10 17:56:01.192628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeShelveTestJSON-929324698 May 10 17:56:01.192628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 0461acfadf8743fdbd62a39bf3fe3e1c May 10 17:56:01.192628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-929324698 May 10 17:56:01.192628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeShelveTestJSON-929324698-project May 10 17:56:01.192628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:56:01.192628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:56:01.192628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: ed37128b78a6454c9c387ad91995a05d May 10 17:56:01.192628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeShelveTestJSON-929324698-project May 10 17:56:01.192628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:56:01.192628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 could not be found. May 10 17:56:01.192628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': 'e16b7603-15a8-44a4-82c9-729bedfb8ac6'} May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 could not be found. May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:56:01.193527 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 could not be found. May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 could not be found. May 10 17:56:01.196891 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:56:01.198360 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-663206a3-1cdc-4153-82f7-a85a4db093ca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Returning 404 to user: Instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:56:01.198360 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-663206a3-1cdc-4153-82f7-a85a4db093ca tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "DELETE /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 404 len: 111 microversion: 2.20 time: 0.030476 May 10 17:56:01.198360 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 527/1065] 10.222.0.60 () {60 vars in 1279 bytes} [Tue May 10 17:56:01 2022] DELETE /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 17:56:01.201681 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ec885c2d-ac1b-47c7-9d12-aa7ec534b038 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:01.202409 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ec885c2d-ac1b-47c7-9d12-aa7ec534b038 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: e16b7603-15a8-44a4-82c9-729bedfb8ac6] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:56:01.208945 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ec885c2d-ac1b-47c7-9d12-aa7ec534b038 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:01.209400 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ec885c2d-ac1b-47c7-9d12-aa7ec534b038 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:01.210175 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ec885c2d-ac1b-47c7-9d12-aa7ec534b038 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:01.211063 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ec885c2d-ac1b-47c7-9d12-aa7ec534b038 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:01.224299 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-ec885c2d-ac1b-47c7-9d12-aa7ec534b038 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] HTTP exception thrown: Instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 could not be found. May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ec885c2d-ac1b-47c7-9d12-aa7ec534b038 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Request method failure captured: May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 HTTP/1.1 May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqSMD5zFR04x6JtjS3MbQUgk0VxFiC3AxAUwRqENdzti4WIBX6ZnMRlb9ahyqq6CXfmlXyunZRn50Sb3_IfgcUypC6NDEkZymbOczMSJO2_nFPa_MFyGFjrTS7PVQLqFgKYAlK1sQJBejX-hEE8hAdGyrLzNihPIdGkmPQwbDx3aW5Y May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Openstack-Nova-Api-Version: 2.20 May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: 0461acfadf8743fdbd62a39bf3fe3e1c May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-929324698 May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:56:01.226061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:56:01.227811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0461acfadf8743fdbd62a39bf3fe3e1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0461acfadf8743fdbd62a39bf3fe3e1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0461acfadf8743fdbd62a39bf3fe3e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0461acfadf8743fdbd62a39bf3fe3e1c"}]}] May 10 17:56:01.227811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-AttachVolumeShelveTestJSON-929324698 May 10 17:56:01.227811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: 0461acfadf8743fdbd62a39bf3fe3e1c May 10 17:56:01.227811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-929324698 May 10 17:56:01.227811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-AttachVolumeShelveTestJSON-929324698-project May 10 17:56:01.227811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:56:01.227811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:56:01.227811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: ed37128b78a6454c9c387ad91995a05d May 10 17:56:01.227811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-AttachVolumeShelveTestJSON-929324698-project May 10 17:56:01.227811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:56:01.227811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 could not be found. May 10 17:56:01.227811 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': 'e16b7603-15a8-44a4-82c9-729bedfb8ac6'} May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 could not be found. May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:56:01.228801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:56:01.230270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:56:01.230270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:56:01.230270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:56:01.230270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:56:01.230270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:56:01.230270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:56:01.230270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:56:01.230270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 could not be found. May 10 17:56:01.230270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:56:01.230270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:56:01.230270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:56:01.230270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:56:01.230270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:56:01.230270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:56:01.230270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:56:01.230270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:56:01.230270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 could not be found. May 10 17:56:01.230270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:56:01.231766 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ec885c2d-ac1b-47c7-9d12-aa7ec534b038 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Returning 404 to user: Instance e16b7603-15a8-44a4-82c9-729bedfb8ac6 could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:56:01.231766 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ec885c2d-ac1b-47c7-9d12-aa7ec534b038 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6" status: 404 len: 111 microversion: 2.20 time: 0.029910 May 10 17:56:01.231766 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 539/1066] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:56:01 2022] GET /compute/v2.1/servers/e16b7603-15a8-44a4-82c9-729bedfb8ac6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 17:56:02.376131 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-533a30df-32cf-489d-b58e-b01ed882fd81 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:02.376659 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-533a30df-32cf-489d-b58e-b01ed882fd81 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:56:02.383783 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-533a30df-32cf-489d-b58e-b01ed882fd81 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:02.384253 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-533a30df-32cf-489d-b58e-b01ed882fd81 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:02.385020 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-533a30df-32cf-489d-b58e-b01ed882fd81 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:02.385456 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-533a30df-32cf-489d-b58e-b01ed882fd81 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:02.400278 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-533a30df-32cf-489d-b58e-b01ed882fd81 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] HTTP exception thrown: Instance 4006eed6-2338-46b7-9133-e5c3fdead35c could not be found. May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-533a30df-32cf-489d-b58e-b01ed882fd81 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Request method failure captured: May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: DELETE /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c HTTP/1.1 May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqSMD5zFR04x6JtjS3MbQUgk0VxFiC3AxAUwRqENdzti4WIBX6ZnMRlb9ahyqq6CXfmlXyunZRn50Sb3_IfgcUypC6NDEkZymbOczMSJO2_nFPa_MFyGFjrTS7PVQLqFgKYAlK1sQJBejX-hEE8hAdGyrLzNihPIdGkmPQwbDx3aW5Y May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Openstack-Nova-Api-Version: 2.20 May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: 0461acfadf8743fdbd62a39bf3fe3e1c May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-929324698 May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:56:02.401874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:56:02.403603 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0461acfadf8743fdbd62a39bf3fe3e1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0461acfadf8743fdbd62a39bf3fe3e1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0461acfadf8743fdbd62a39bf3fe3e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0461acfadf8743fdbd62a39bf3fe3e1c"}]}] May 10 17:56:02.403603 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeShelveTestJSON-929324698 May 10 17:56:02.403603 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: 0461acfadf8743fdbd62a39bf3fe3e1c May 10 17:56:02.403603 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-929324698 May 10 17:56:02.403603 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeShelveTestJSON-929324698-project May 10 17:56:02.403603 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:56:02.403603 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:56:02.403603 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: ed37128b78a6454c9c387ad91995a05d May 10 17:56:02.403603 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeShelveTestJSON-929324698-project May 10 17:56:02.403603 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:56:02.403603 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance 4006eed6-2338-46b7-9133-e5c3fdead35c could not be found. May 10 17:56:02.403603 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': '4006eed6-2338-46b7-9133-e5c3fdead35c'} May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4006eed6-2338-46b7-9133-e5c3fdead35c could not be found. May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:56:02.404483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4006eed6-2338-46b7-9133-e5c3fdead35c could not be found. May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4006eed6-2338-46b7-9133-e5c3fdead35c could not be found. May 10 17:56:02.405907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:56:02.407289 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-533a30df-32cf-489d-b58e-b01ed882fd81 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Returning 404 to user: Instance 4006eed6-2338-46b7-9133-e5c3fdead35c could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:56:02.407289 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-533a30df-32cf-489d-b58e-b01ed882fd81 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 404 len: 111 microversion: 2.20 time: 0.031240 May 10 17:56:02.407289 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 528/1067] 10.222.0.60 () {60 vars in 1279 bytes} [Tue May 10 17:56:02 2022] DELETE /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 10 17:56:02.414615 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-bacdcea9-32e5-4729-9bcc-e30d9873b801 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:02.415329 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-bacdcea9-32e5-4729-9bcc-e30d9873b801 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] [instance: 4006eed6-2338-46b7-9133-e5c3fdead35c] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:56:02.421877 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bacdcea9-32e5-4729-9bcc-e30d9873b801 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:02.422410 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bacdcea9-32e5-4729-9bcc-e30d9873b801 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:02.423192 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bacdcea9-32e5-4729-9bcc-e30d9873b801 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:02.423662 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bacdcea9-32e5-4729-9bcc-e30d9873b801 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:02.440095 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-bacdcea9-32e5-4729-9bcc-e30d9873b801 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] HTTP exception thrown: Instance 4006eed6-2338-46b7-9133-e5c3fdead35c could not be found. May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-bacdcea9-32e5-4729-9bcc-e30d9873b801 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Request method failure captured: May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c HTTP/1.1 May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqSMD5zFR04x6JtjS3MbQUgk0VxFiC3AxAUwRqENdzti4WIBX6ZnMRlb9ahyqq6CXfmlXyunZRn50Sb3_IfgcUypC6NDEkZymbOczMSJO2_nFPa_MFyGFjrTS7PVQLqFgKYAlK1sQJBejX-hEE8hAdGyrLzNihPIdGkmPQwbDx3aW5Y May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Openstack-Nova-Api-Version: 2.20 May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: 0461acfadf8743fdbd62a39bf3fe3e1c May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-929324698 May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:56:02.441645 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:56:02.443281 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0461acfadf8743fdbd62a39bf3fe3e1c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/0461acfadf8743fdbd62a39bf3fe3e1c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_0461acfadf8743fdbd62a39bf3fe3e1c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/0461acfadf8743fdbd62a39bf3fe3e1c"}]}] May 10 17:56:02.443281 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-AttachVolumeShelveTestJSON-929324698 May 10 17:56:02.443281 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: 0461acfadf8743fdbd62a39bf3fe3e1c May 10 17:56:02.443281 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-929324698 May 10 17:56:02.443281 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-AttachVolumeShelveTestJSON-929324698-project May 10 17:56:02.443281 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:56:02.443281 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:56:02.443281 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: ed37128b78a6454c9c387ad91995a05d May 10 17:56:02.443281 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-AttachVolumeShelveTestJSON-929324698-project May 10 17:56:02.443281 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:56:02.443281 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance 4006eed6-2338-46b7-9133-e5c3fdead35c could not be found. May 10 17:56:02.443281 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': '4006eed6-2338-46b7-9133-e5c3fdead35c'} May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4006eed6-2338-46b7-9133-e5c3fdead35c could not be found. May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:56:02.444193 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:56:02.446280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:56:02.446280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:56:02.446280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:56:02.446280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:56:02.446280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:56:02.446280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:56:02.446280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:56:02.446280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4006eed6-2338-46b7-9133-e5c3fdead35c could not be found. May 10 17:56:02.446280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:56:02.446280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:56:02.446280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:56:02.446280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:56:02.446280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:56:02.446280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:56:02.446280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:56:02.446280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:56:02.446280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4006eed6-2338-46b7-9133-e5c3fdead35c could not be found. May 10 17:56:02.446280 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:56:02.447575 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-bacdcea9-32e5-4729-9bcc-e30d9873b801 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] Returning 404 to user: Instance 4006eed6-2338-46b7-9133-e5c3fdead35c could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:56:02.447575 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-bacdcea9-32e5-4729-9bcc-e30d9873b801 tempest-AttachVolumeShelveTestJSON-929324698 tempest-AttachVolumeShelveTestJSON-929324698-project] 10.222.0.60 "GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c" status: 404 len: 111 microversion: 2.20 time: 0.033258 May 10 17:56:02.447575 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 540/1068] 10.222.0.60 () {60 vars in 1276 bytes} [Tue May 10 17:56:02 2022] GET /compute/v2.1/servers/4006eed6-2338-46b7-9133-e5c3fdead35c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 10 17:56:06.972685 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9016ffc8-5b98-461e-8b31-c5c6763a2aef tempest-VolumesGetTestJSON-1539067765 tempest-VolumesGetTestJSON-1539067765-project] Action: 'create', calling method: .version_select at 0x7f3e769fc040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-451849154", "metadata": {"Type": "work"}}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:56:07.259959 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9016ffc8-5b98-461e-8b31-c5c6763a2aef tempest-VolumesGetTestJSON-1539067765 tempest-VolumesGetTestJSON-1539067765-project] 10.222.0.60 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.409528 May 10 17:56:07.260578 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 529/1069] 10.222.0.60 () {60 vars in 1155 bytes} [Tue May 10 17:56:06 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 411 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 10 17:56:07.271646 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a297192d-1db5-4b0c-bdef-f10f356c14a1 tempest-VolumesGetTestJSON-1539067765 tempest-VolumesGetTestJSON-1539067765-project] Calling method '.version_select at 0x7f3e7b94caf0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:07.323192 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a297192d-1db5-4b0c-bdef-f10f356c14a1 tempest-VolumesGetTestJSON-1539067765 tempest-VolumesGetTestJSON-1539067765-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8abbadc5-74d6-4c07-862f-fe3b6e9acee9" status: 200 len: 352 microversion: 2.1 time: 0.055462 May 10 17:56:07.323794 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 541/1070] 10.222.0.60 () {58 vars in 1244 bytes} [Tue May 10 17:56:07 2022] GET /compute/v2.1/os-volumes/8abbadc5-74d6-4c07-862f-fe3b6e9acee9 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:56:08.337144 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4a1b61a3-a240-46c8-8753-ae404d2e0a6e tempest-VolumesGetTestJSON-1539067765 tempest-VolumesGetTestJSON-1539067765-project] Calling method '.version_select at 0x7f3e76c90040>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:08.383154 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4a1b61a3-a240-46c8-8753-ae404d2e0a6e tempest-VolumesGetTestJSON-1539067765 tempest-VolumesGetTestJSON-1539067765-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8abbadc5-74d6-4c07-862f-fe3b6e9acee9" status: 200 len: 352 microversion: 2.1 time: 0.050844 May 10 17:56:08.383680 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 530/1071] 10.222.0.60 () {58 vars in 1244 bytes} [Tue May 10 17:56:08 2022] GET /compute/v2.1/os-volumes/8abbadc5-74d6-4c07-862f-fe3b6e9acee9 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:56:08.407316 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5fbfdce7-1e11-48db-9931-75f41313db57 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:08.407917 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5fbfdce7-1e11-48db-9931-75f41313db57 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:56:08.414521 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5fbfdce7-1e11-48db-9931-75f41313db57 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:08.414969 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5fbfdce7-1e11-48db-9931-75f41313db57 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:08.415772 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5fbfdce7-1e11-48db-9931-75f41313db57 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:08.416207 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5fbfdce7-1e11-48db-9931-75f41313db57 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:08.498894 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.objects.instance [None req-5fbfdce7-1e11-48db-9931-75f41313db57 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lazy-loading 'services' on Instance uuid f67aef06-0fe1-4ec5-a643-e51baea32b2e {{(pid=123753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:56:08.572499 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-5fbfdce7-1e11-48db-9931-75f41313db57 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e/os-volume_attachments/fbc19591-95ce-4b62-bd5c-1db336260a2e" status: 202 len: 0 microversion: 2.1 time: 0.169489 May 10 17:56:08.573148 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 542/1072] 10.222.0.60 () {58 vars in 1415 bytes} [Tue May 10 17:56:08 2022] DELETE /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e/os-volume_attachments/fbc19591-95ce-4b62-bd5c-1db336260a2e => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:56:09.395916 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5930f38a-e60e-4b49-ab21-e1a912d2c428 tempest-VolumesGetTestJSON-1539067765 tempest-VolumesGetTestJSON-1539067765-project] Calling method '.version_select at 0x7f3e7697a430>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:09.444365 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5930f38a-e60e-4b49-ab21-e1a912d2c428 tempest-VolumesGetTestJSON-1539067765 tempest-VolumesGetTestJSON-1539067765-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8abbadc5-74d6-4c07-862f-fe3b6e9acee9" status: 200 len: 353 microversion: 2.1 time: 0.052690 May 10 17:56:09.445623 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 531/1073] 10.222.0.60 () {58 vars in 1244 bytes} [Tue May 10 17:56:09 2022] GET /compute/v2.1/os-volumes/8abbadc5-74d6-4c07-862f-fe3b6e9acee9 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:56:09.457592 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-d05cb8d5-9722-4458-9529-b162a7749c32 tempest-VolumesGetTestJSON-1539067765 tempest-VolumesGetTestJSON-1539067765-project] Calling method '.version_select at 0x7f3e7b94cee0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:09.642411 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-d05cb8d5-9722-4458-9529-b162a7749c32 tempest-VolumesGetTestJSON-1539067765 tempest-VolumesGetTestJSON-1539067765-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8abbadc5-74d6-4c07-862f-fe3b6e9acee9" status: 200 len: 353 microversion: 2.1 time: 0.189102 May 10 17:56:09.642987 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 543/1074] 10.222.0.60 () {58 vars in 1244 bytes} [Tue May 10 17:56:09 2022] GET /compute/v2.1/os-volumes/8abbadc5-74d6-4c07-862f-fe3b6e9acee9 => generated 353 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:56:09.660375 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-4069d2c2-257a-42c3-9d9d-9b854dce880a tempest-VolumesGetTestJSON-1539067765 tempest-VolumesGetTestJSON-1539067765-project] Calling method '.version_select at 0x7f3e76a1c3a0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:09.790012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-29364caa-5677-4031-a0b7-4b3a43985c68 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:56:09.796528 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-29364caa-5677-4031-a0b7-4b3a43985c68 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:09.796990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-29364caa-5677-4031-a0b7-4b3a43985c68 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:09.831452 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-4069d2c2-257a-42c3-9d9d-9b854dce880a tempest-VolumesGetTestJSON-1539067765 tempest-VolumesGetTestJSON-1539067765-project] 10.222.0.60 "DELETE /compute/v2.1/os-volumes/8abbadc5-74d6-4c07-862f-fe3b6e9acee9" status: 202 len: 0 microversion: 2.1 time: 0.174886 May 10 17:56:09.837079 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 532/1075] 10.222.0.60 () {58 vars in 1247 bytes} [Tue May 10 17:56:09 2022] DELETE /compute/v2.1/os-volumes/8abbadc5-74d6-4c07-862f-fe3b6e9acee9 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:56:09.845679 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e1e853a6-47f2-4c8b-939c-a20ce17f03b8 tempest-VolumesGetTestJSON-1539067765 tempest-VolumesGetTestJSON-1539067765-project] Calling method '.version_select at 0x7f3e769960d0>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:09.861535 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-29364caa-5677-4031-a0b7-4b3a43985c68 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Going to try to stop instance {{(pid=123753) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 10 17:56:09.904543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e1e853a6-47f2-4c8b-939c-a20ce17f03b8 tempest-VolumesGetTestJSON-1539067765 tempest-VolumesGetTestJSON-1539067765-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8abbadc5-74d6-4c07-862f-fe3b6e9acee9" status: 200 len: 352 microversion: 2.1 time: 0.062678 May 10 17:56:09.905142 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 533/1076] 10.222.0.60 () {58 vars in 1244 bytes} [Tue May 10 17:56:09 2022] GET /compute/v2.1/os-volumes/8abbadc5-74d6-4c07-862f-fe3b6e9acee9 => generated 352 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:56:09.907711 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-29364caa-5677-4031-a0b7-4b3a43985c68 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "POST /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e/action" status: 202 len: 0 microversion: 2.1 time: 0.122107 May 10 17:56:09.908399 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 544/1077] 10.222.0.60 () {60 vars in 1277 bytes} [Tue May 10 17:56:09 2022] POST /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 17:56:09.918221 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-42dddd12-0b27-4955-a2a2-2252bd84fef5 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:09.918850 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-42dddd12-0b27-4955-a2a2-2252bd84fef5 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:56:09.925303 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-42dddd12-0b27-4955-a2a2-2252bd84fef5 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:09.925983 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-42dddd12-0b27-4955-a2a2-2252bd84fef5 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:09.926605 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-42dddd12-0b27-4955-a2a2-2252bd84fef5 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:09.927062 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-42dddd12-0b27-4955-a2a2-2252bd84fef5 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:10.062160 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-42dddd12-0b27-4955-a2a2-2252bd84fef5 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:56:10.069929 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-42dddd12-0b27-4955-a2a2-2252bd84fef5 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1675 microversion: 2.1 time: 0.155944 May 10 17:56:10.070508 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 534/1078] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:56:09 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:56:10.918026 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-113cfcb4-f6b3-440c-a458-d8c2ef124c32 tempest-VolumesGetTestJSON-1539067765 tempest-VolumesGetTestJSON-1539067765-project] Calling method '.version_select at 0x7f3e7ba1a8b0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:10.948246 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-113cfcb4-f6b3-440c-a458-d8c2ef124c32 tempest-VolumesGetTestJSON-1539067765 tempest-VolumesGetTestJSON-1539067765-project] HTTP exception thrown: Volume 8abbadc5-74d6-4c07-862f-fe3b6e9acee9 could not be found. May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-113cfcb4-f6b3-440c-a458-d8c2ef124c32 tempest-VolumesGetTestJSON-1539067765 tempest-VolumesGetTestJSON-1539067765-project] Request method failure captured: May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/os-volumes/8abbadc5-74d6-4c07-862f-fe3b6e9acee9 HTTP/1.1 May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqc25lyeZBCIKe6w0kispGBmpDeZ__-4v0XXwvPe5fTnTFDu7V1kuXQVc1K4sB1bFXt0PPG6jejzsabhN3McNnKcMoVEOz8SQj8BXY4bgrwvqFcyTKHBXbueYMj6naG7X6GGE4EsVLgCSG2FtMWTcuJq7oWgd2mVlnskHRsbvQyb8ts May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: 1c6d7d8385c643b8a61803cd8f01c960 May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-VolumesGetTestJSON-1539067765 May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:56:10.950701 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:56:10.952417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1c6d7d8385c643b8a61803cd8f01c960"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/1c6d7d8385c643b8a61803cd8f01c960"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_1c6d7d8385c643b8a61803cd8f01c960"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/1c6d7d8385c643b8a61803cd8f01c960"}]}] May 10 17:56:10.952417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-VolumesGetTestJSON-1539067765 May 10 17:56:10.952417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: 1c6d7d8385c643b8a61803cd8f01c960 May 10 17:56:10.952417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-VolumesGetTestJSON-1539067765 May 10 17:56:10.952417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-VolumesGetTestJSON-1539067765-project May 10 17:56:10.952417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:56:10.952417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:56:10.952417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: 47f94493835b463382b4c1f3564adb9e May 10 17:56:10.952417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-VolumesGetTestJSON-1539067765-project May 10 17:56:10.952417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: May 10 17:56:10.952417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Volume 8abbadc5-74d6-4c07-862f-fe3b6e9acee9 could not be found. May 10 17:56:10.952417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': '8abbadc5-74d6-4c07-862f-fe3b6e9acee9'} May 10 17:56:10.952417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:56:10.956476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:56:10.956476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 17:56:10.956476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 17:56:10.956476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 17:56:10.956476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 17:56:10.956476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 17:56:10.956476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 17:56:10.956476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 17:56:10.956476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 17:56:10.956476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 17:56:10.956476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 17:56:10.956476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 17:56:10.956476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 17:56:10.956476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 17:56:10.956476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 17:56:10.956476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8abbadc5-74d6-4c07-862f-fe3b6e9acee9 could not be found. (HTTP 404) (Request-ID: req-5d06ee27-2094-4706-9e2e-97201a4140f2) May 10 17:56:10.956476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:56:10.956476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:56:10.956476 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:56:10.957928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:56:10.957928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 10 17:56:10.957928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 10 17:56:10.957928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 10 17:56:10.957928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 10 17:56:10.957928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 10 17:56:10.957928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 10 17:56:10.957928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 10 17:56:10.957928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 10 17:56:10.957928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 10 17:56:10.957928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 10 17:56:10.957928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 10 17:56:10.957928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi item = cinderclient( May 10 17:56:10.957928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 10 17:56:10.957928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 10 17:56:10.957928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 10 17:56:10.957928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 10 17:56:10.957928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 10 17:56:10.957928 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 10 17:56:10.959292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 10 17:56:10.959292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 10 17:56:10.959292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 10 17:56:10.959292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 10 17:56:10.959292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8abbadc5-74d6-4c07-862f-fe3b6e9acee9 could not be found. May 10 17:56:10.959292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:56:10.959292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:56:10.959292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:56:10.959292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:56:10.959292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:56:10.959292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:56:10.959292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:56:10.959292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:56:10.959292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 10 17:56:10.959292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 10 17:56:10.959292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:56:10.959292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:56:10.959292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 10 17:56:10.959292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:56:10.961277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8abbadc5-74d6-4c07-862f-fe3b6e9acee9 could not be found. May 10 17:56:10.961277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:56:10.961277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:56:10.961277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:56:10.961277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:56:10.961277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:56:10.961277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:56:10.961277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:56:10.961277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:56:10.961277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8abbadc5-74d6-4c07-862f-fe3b6e9acee9 could not be found. May 10 17:56:10.961277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:56:10.961277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-113cfcb4-f6b3-440c-a458-d8c2ef124c32 tempest-VolumesGetTestJSON-1539067765 tempest-VolumesGetTestJSON-1539067765-project] Returning 404 to user: Volume 8abbadc5-74d6-4c07-862f-fe3b6e9acee9 could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:56:10.961277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-113cfcb4-f6b3-440c-a458-d8c2ef124c32 tempest-VolumesGetTestJSON-1539067765 tempest-VolumesGetTestJSON-1539067765-project] 10.222.0.60 "GET /compute/v2.1/os-volumes/8abbadc5-74d6-4c07-862f-fe3b6e9acee9" status: 404 len: 109 microversion: 2.1 time: 0.038917 May 10 17:56:10.961277 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 545/1079] 10.222.0.60 () {58 vars in 1244 bytes} [Tue May 10 17:56:10 2022] GET /compute/v2.1/os-volumes/8abbadc5-74d6-4c07-862f-fe3b6e9acee9 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:56:11.088294 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-262e4f24-2cfb-42ba-81a7-5a38e2126035 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:11.088949 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-262e4f24-2cfb-42ba-81a7-5a38e2126035 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:56:11.095750 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-262e4f24-2cfb-42ba-81a7-5a38e2126035 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:11.096455 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-262e4f24-2cfb-42ba-81a7-5a38e2126035 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:11.097369 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-262e4f24-2cfb-42ba-81a7-5a38e2126035 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:11.097921 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-262e4f24-2cfb-42ba-81a7-5a38e2126035 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:11.237769 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-262e4f24-2cfb-42ba-81a7-5a38e2126035 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:56:11.246122 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-262e4f24-2cfb-42ba-81a7-5a38e2126035 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1675 microversion: 2.1 time: 0.162714 May 10 17:56:11.246692 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 535/1080] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:56:11 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:56:12.262514 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-99ed5772-0905-4389-8964-31a5e8d6d8ba tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:12.263242 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-99ed5772-0905-4389-8964-31a5e8d6d8ba tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:56:12.269687 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-99ed5772-0905-4389-8964-31a5e8d6d8ba tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:12.270136 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-99ed5772-0905-4389-8964-31a5e8d6d8ba tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:12.270908 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-99ed5772-0905-4389-8964-31a5e8d6d8ba tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:12.271581 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-99ed5772-0905-4389-8964-31a5e8d6d8ba tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:12.706348 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-99ed5772-0905-4389-8964-31a5e8d6d8ba tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:56:12.716825 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-99ed5772-0905-4389-8964-31a5e8d6d8ba tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1675 microversion: 2.1 time: 0.458682 May 10 17:56:12.717567 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 546/1081] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:56:12 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1675 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:56:13.734437 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e7ecbe18-ddce-4e90-b2a3-5b6db67cbadf tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:13.735047 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e7ecbe18-ddce-4e90-b2a3-5b6db67cbadf tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:56:13.741483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7ecbe18-ddce-4e90-b2a3-5b6db67cbadf tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:13.741925 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7ecbe18-ddce-4e90-b2a3-5b6db67cbadf tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:13.742775 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7ecbe18-ddce-4e90-b2a3-5b6db67cbadf tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:13.743281 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7ecbe18-ddce-4e90-b2a3-5b6db67cbadf tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:13.880980 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e7ecbe18-ddce-4e90-b2a3-5b6db67cbadf tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:56:13.889044 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e7ecbe18-ddce-4e90-b2a3-5b6db67cbadf tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1675 microversion: 2.1 time: 0.158875 May 10 17:56:13.889614 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 536/1082] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:56:13 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:56:14.905830 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-af6bb57a-6666-4c18-a9ea-18ee579a4d9c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:14.906461 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-af6bb57a-6666-4c18-a9ea-18ee579a4d9c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:56:14.913828 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-af6bb57a-6666-4c18-a9ea-18ee579a4d9c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:14.914468 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-af6bb57a-6666-4c18-a9ea-18ee579a4d9c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:14.915357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-af6bb57a-6666-4c18-a9ea-18ee579a4d9c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:14.915993 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-af6bb57a-6666-4c18-a9ea-18ee579a4d9c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:15.063691 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-af6bb57a-6666-4c18-a9ea-18ee579a4d9c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:56:15.071829 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-af6bb57a-6666-4c18-a9ea-18ee579a4d9c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1675 microversion: 2.1 time: 0.169766 May 10 17:56:15.072410 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 547/1083] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:56:14 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:56:16.092443 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-adbb0070-0fb6-49d7-a8fe-765ed4e86112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:16.093061 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-adbb0070-0fb6-49d7-a8fe-765ed4e86112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:56:16.099670 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-adbb0070-0fb6-49d7-a8fe-765ed4e86112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:16.100138 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-adbb0070-0fb6-49d7-a8fe-765ed4e86112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:16.101415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-adbb0070-0fb6-49d7-a8fe-765ed4e86112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:16.102018 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-adbb0070-0fb6-49d7-a8fe-765ed4e86112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:16.292978 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-adbb0070-0fb6-49d7-a8fe-765ed4e86112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:56:16.301433 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-adbb0070-0fb6-49d7-a8fe-765ed4e86112 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1675 microversion: 2.1 time: 0.212810 May 10 17:56:16.311495 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 537/1084] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:56:16 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1675 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:56:17.319098 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b4e6bf84-5bd0-4c63-94da-9f939e3e2780 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:17.320526 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-b4e6bf84-5bd0-4c63-94da-9f939e3e2780 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:56:17.327385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b4e6bf84-5bd0-4c63-94da-9f939e3e2780 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:17.328040 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b4e6bf84-5bd0-4c63-94da-9f939e3e2780 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:17.328889 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b4e6bf84-5bd0-4c63-94da-9f939e3e2780 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:17.329394 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b4e6bf84-5bd0-4c63-94da-9f939e3e2780 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:17.647136 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b4e6bf84-5bd0-4c63-94da-9f939e3e2780 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:56:17.656321 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b4e6bf84-5bd0-4c63-94da-9f939e3e2780 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1675 microversion: 2.1 time: 0.341357 May 10 17:56:17.656925 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 548/1085] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:56:17 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1675 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:56:18.672278 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-74721cda-fc7b-4fa1-b705-9626da819cac tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:18.672903 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-74721cda-fc7b-4fa1-b705-9626da819cac tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:56:18.680568 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-74721cda-fc7b-4fa1-b705-9626da819cac tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:18.681035 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-74721cda-fc7b-4fa1-b705-9626da819cac tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:18.681843 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-74721cda-fc7b-4fa1-b705-9626da819cac tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:18.682295 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-74721cda-fc7b-4fa1-b705-9626da819cac tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:18.820825 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-74721cda-fc7b-4fa1-b705-9626da819cac tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:56:18.828574 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-74721cda-fc7b-4fa1-b705-9626da819cac tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1675 microversion: 2.1 time: 0.160158 May 10 17:56:18.829143 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 538/1086] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:56:18 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:56:19.846056 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e9988e08-14ce-4287-97ed-0967f60045df tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:19.846675 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e9988e08-14ce-4287-97ed-0967f60045df tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:56:19.853661 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e9988e08-14ce-4287-97ed-0967f60045df tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:19.854212 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e9988e08-14ce-4287-97ed-0967f60045df tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:19.854913 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e9988e08-14ce-4287-97ed-0967f60045df tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:19.855352 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e9988e08-14ce-4287-97ed-0967f60045df tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:19.999230 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e9988e08-14ce-4287-97ed-0967f60045df tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:56:20.006876 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e9988e08-14ce-4287-97ed-0967f60045df tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1675 microversion: 2.1 time: 0.164793 May 10 17:56:20.007449 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 549/1087] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:56:19 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:56:21.024343 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-98b9af26-c59d-49fb-9ef6-31a795223089 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:21.024956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-98b9af26-c59d-49fb-9ef6-31a795223089 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:56:21.031315 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98b9af26-c59d-49fb-9ef6-31a795223089 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:21.031813 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98b9af26-c59d-49fb-9ef6-31a795223089 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:21.032606 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98b9af26-c59d-49fb-9ef6-31a795223089 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:21.033053 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-98b9af26-c59d-49fb-9ef6-31a795223089 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:21.171758 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-98b9af26-c59d-49fb-9ef6-31a795223089 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:56:21.180119 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-98b9af26-c59d-49fb-9ef6-31a795223089 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1652 microversion: 2.1 time: 0.160303 May 10 17:56:21.180699 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 539/1088] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:56:21 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1652 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:56:21.203744 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c3f2da8f-1be1-49ae-b633-20fd6fe20f30 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:56:21.211933 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c3f2da8f-1be1-49ae-b633-20fd6fe20f30 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:21.212449 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c3f2da8f-1be1-49ae-b633-20fd6fe20f30 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:21.238051 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c3f2da8f-1be1-49ae-b633-20fd6fe20f30 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Going to try to start instance {{(pid=123753) start /opt/stack/nova/nova/compute/api.py:2730}} May 10 17:56:21.295486 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c3f2da8f-1be1-49ae-b633-20fd6fe20f30 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "POST /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e/action" status: 202 len: 0 microversion: 2.1 time: 0.095724 May 10 17:56:21.296344 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 550/1089] 10.222.0.60 () {60 vars in 1277 bytes} [Tue May 10 17:56:21 2022] POST /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 10 17:56:21.310524 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2f1f7343-77ac-49dc-8c2f-7f3494cbe35d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:21.311528 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2f1f7343-77ac-49dc-8c2f-7f3494cbe35d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:56:21.321354 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2f1f7343-77ac-49dc-8c2f-7f3494cbe35d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:21.322296 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2f1f7343-77ac-49dc-8c2f-7f3494cbe35d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:21.323575 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2f1f7343-77ac-49dc-8c2f-7f3494cbe35d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:21.323963 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2f1f7343-77ac-49dc-8c2f-7f3494cbe35d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:21.554916 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2f1f7343-77ac-49dc-8c2f-7f3494cbe35d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:56:21.563614 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2f1f7343-77ac-49dc-8c2f-7f3494cbe35d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1661 microversion: 2.1 time: 0.262070 May 10 17:56:21.564788 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 540/1090] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:56:21 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1661 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:56:22.584312 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b77a1364-19d1-40c8-a260-21d0f716158d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:22.585219 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-b77a1364-19d1-40c8-a260-21d0f716158d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:56:22.593114 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b77a1364-19d1-40c8-a260-21d0f716158d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:22.593566 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b77a1364-19d1-40c8-a260-21d0f716158d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:22.594573 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b77a1364-19d1-40c8-a260-21d0f716158d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:22.595209 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b77a1364-19d1-40c8-a260-21d0f716158d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:22.749628 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b77a1364-19d1-40c8-a260-21d0f716158d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:56:22.758332 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b77a1364-19d1-40c8-a260-21d0f716158d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1661 microversion: 2.1 time: 0.179900 May 10 17:56:22.758920 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 551/1091] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:56:22 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1661 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:56:23.775756 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-16f49d67-4059-4aaf-bb35-d8f6a34f13be tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:56:23.776626 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-16f49d67-4059-4aaf-bb35-d8f6a34f13be tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:56:23.783479 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-16f49d67-4059-4aaf-bb35-d8f6a34f13be tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:23.784021 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-16f49d67-4059-4aaf-bb35-d8f6a34f13be tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:23.784911 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-16f49d67-4059-4aaf-bb35-d8f6a34f13be tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:56:23.785489 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-16f49d67-4059-4aaf-bb35-d8f6a34f13be tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:56:23.948371 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-16f49d67-4059-4aaf-bb35-d8f6a34f13be tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:56:23.956145 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-16f49d67-4059-4aaf-bb35-d8f6a34f13be tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1665 microversion: 2.1 time: 0.184459 May 10 17:56:23.956756 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 541/1092] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:56:23 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1665 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:56:31.674984 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:56:31.675564 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Tue May 10 17:56:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:57:08.196420 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-65278487-d139-4147-8943-40c850ce6937 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1250245151", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-630683051", "security_groups": [{"name": "tempest-secgroup-smoke-900555845"}], "block_device_mapping_v2": [{"uuid": "9d5b45cf-726f-47af-8032-c9b75a4b4076", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0e710c0b-0b9b-4762-af88-7b56961d06bc"}]}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:57:08.308132 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.network.neutron [None req-65278487-d139-4147-8943-40c850ce6937 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] validate_networks() for [('0e710c0b-0b9b-4762-af88-7b56961d06bc', None, None, None, None, None)] {{(pid=123753) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:57:08.816172 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-65278487-d139-4147-8943-40c850ce6937 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Flavor limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:57:08.817605 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-65278487-d139-4147-8943-40c850ce6937 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Image limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:57:08.818168 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-65278487-d139-4147-8943-40c850ce6937 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Flavor pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:57:08.818573 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-65278487-d139-4147-8943-40c850ce6937 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Image pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:57:08.818971 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-65278487-d139-4147-8943-40c850ce6937 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:57:08.829292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-65278487-d139-4147-8943-40c850ce6937 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:08.830218 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-65278487-d139-4147-8943-40c850ce6937 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:08.831198 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-65278487-d139-4147-8943-40c850ce6937 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:08.831660 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-65278487-d139-4147-8943-40c850ce6937 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:08.849282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-65278487-d139-4147-8943-40c850ce6937 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Getting quotas for project c93f0e69798e491aba3c8cf1493c2733. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:57:08.853198 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-65278487-d139-4147-8943-40c850ce6937 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Getting quotas for user 798edb753845410fa6f9c136b43abf05 and project c93f0e69798e491aba3c8cf1493c2733. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:57:08.912528 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-65278487-d139-4147-8943-40c850ce6937 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Going to run 1 instances... {{(pid=123753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:57:08.914624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-65278487-d139-4147-8943-40c850ce6937 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9d5b45cf-726f-47af-8032-c9b75a4b4076',volume_size=None,volume_type=None)] {{(pid=123753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:57:09.039147 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-65278487-d139-4147-8943-40c850ce6937 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.846659 May 10 17:57:09.039891 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 552/1093] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 17:57:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 848 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:57:09.050641 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a5143323-16c3-4b36-8f05-78a9cd02988c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:57:09.051402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a5143323-16c3-4b36-8f05-78a9cd02988c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:57:09.110556 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a5143323-16c3-4b36-8f05-78a9cd02988c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:57:09.119184 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a5143323-16c3-4b36-8f05-78a9cd02988c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1094 microversion: 2.1 time: 0.072347 May 10 17:57:09.120058 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 542/1094] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:57:09 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:57:10.138144 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-cb9c0e18-2909-4ae6-8567-e27e1e8ecdd0 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:57:10.139048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-cb9c0e18-2909-4ae6-8567-e27e1e8ecdd0 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:57:10.145697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cb9c0e18-2909-4ae6-8567-e27e1e8ecdd0 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:10.146063 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cb9c0e18-2909-4ae6-8567-e27e1e8ecdd0 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:10.146816 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cb9c0e18-2909-4ae6-8567-e27e1e8ecdd0 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:10.147263 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-cb9c0e18-2909-4ae6-8567-e27e1e8ecdd0 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:10.250338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-cb9c0e18-2909-4ae6-8567-e27e1e8ecdd0 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:57:10.261438 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-cb9c0e18-2909-4ae6-8567-e27e1e8ecdd0 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1200 microversion: 2.1 time: 0.127690 May 10 17:57:10.264104 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 553/1095] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:57:10 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1200 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:57:11.283078 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0edf7763-24e5-4390-8952-8e88178f70b4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:57:11.283808 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0edf7763-24e5-4390-8952-8e88178f70b4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:57:11.292172 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0edf7763-24e5-4390-8952-8e88178f70b4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:11.292894 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0edf7763-24e5-4390-8952-8e88178f70b4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:11.294628 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0edf7763-24e5-4390-8952-8e88178f70b4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:11.295276 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0edf7763-24e5-4390-8952-8e88178f70b4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:11.655350 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0edf7763-24e5-4390-8952-8e88178f70b4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:57:11.664642 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0edf7763-24e5-4390-8952-8e88178f70b4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1265 microversion: 2.1 time: 0.387676 May 10 17:57:11.675766 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 543/1096] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:57:11 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1265 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:57:12.196879 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-fffedd62-fe47-440b-bde0-acae619c4e03 req-a5ea9f4f-11bc-40e7-894f-0691fd4f8392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10549f70-f1b2-414c-80e7-f79e0acb1ae1", "tag": "fb74e985-7afc-4d8a-a0ab-c3df196c6c97"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:57:12.211533 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-fffedd62-fe47-440b-bde0-acae619c4e03 req-a5ea9f4f-11bc-40e7-894f-0691fd4f8392 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:12.211989 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-fffedd62-fe47-440b-bde0-acae619c4e03 req-a5ea9f4f-11bc-40e7-894f-0691fd4f8392 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:12.244207 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-fffedd62-fe47-440b-bde0-acae619c4e03 req-a5ea9f4f-11bc-40e7-894f-0691fd4f8392 service nova] Creating event network-changed:fb74e985-7afc-4d8a-a0ab-c3df196c6c97 for instance 10549f70-f1b2-414c-80e7-f79e0acb1ae1 on hv-cinder-84130 May 10 17:57:12.252247 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-fffedd62-fe47-440b-bde0-acae619c4e03 req-a5ea9f4f-11bc-40e7-894f-0691fd4f8392 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059165 May 10 17:57:12.253044 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 554/1097] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:57:12.684091 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a290118f-a34f-4b8e-b920-176c4d8b5a94 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:57:12.684775 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a290118f-a34f-4b8e-b920-176c4d8b5a94 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:57:12.691578 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a290118f-a34f-4b8e-b920-176c4d8b5a94 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:12.692329 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a290118f-a34f-4b8e-b920-176c4d8b5a94 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:12.693643 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a290118f-a34f-4b8e-b920-176c4d8b5a94 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:12.694305 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a290118f-a34f-4b8e-b920-176c4d8b5a94 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:12.856467 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a290118f-a34f-4b8e-b920-176c4d8b5a94 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:57:12.864410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a290118f-a34f-4b8e-b920-176c4d8b5a94 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1265 microversion: 2.1 time: 0.185701 May 10 17:57:12.865067 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 544/1098] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:57:12 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:57:13.882584 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-7c16bf10-3676-4bbc-8c62-c1099701fead tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:57:13.883279 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-7c16bf10-3676-4bbc-8c62-c1099701fead tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:57:13.890057 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7c16bf10-3676-4bbc-8c62-c1099701fead tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:13.890511 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7c16bf10-3676-4bbc-8c62-c1099701fead tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:13.891292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7c16bf10-3676-4bbc-8c62-c1099701fead tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:13.891780 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-7c16bf10-3676-4bbc-8c62-c1099701fead tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:14.111014 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-7c16bf10-3676-4bbc-8c62-c1099701fead tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:57:14.119111 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-7c16bf10-3676-4bbc-8c62-c1099701fead tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1265 microversion: 2.1 time: 0.241163 May 10 17:57:14.119708 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 555/1099] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:57:13 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:57:15.139080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-83ca912f-544e-4dc0-b4ed-8c45f26bd03b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:57:15.139842 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-83ca912f-544e-4dc0-b4ed-8c45f26bd03b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:57:15.146460 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-83ca912f-544e-4dc0-b4ed-8c45f26bd03b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:15.146915 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-83ca912f-544e-4dc0-b4ed-8c45f26bd03b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:15.147720 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-83ca912f-544e-4dc0-b4ed-8c45f26bd03b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:15.148160 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-83ca912f-544e-4dc0-b4ed-8c45f26bd03b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:15.291337 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-83ca912f-544e-4dc0-b4ed-8c45f26bd03b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:57:15.300076 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-83ca912f-544e-4dc0-b4ed-8c45f26bd03b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1265 microversion: 2.1 time: 0.165423 May 10 17:57:15.300668 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 545/1100] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:57:15 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:57:16.317535 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-831881cd-434d-4a7c-8495-e45286a95909 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:57:16.318137 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-831881cd-434d-4a7c-8495-e45286a95909 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:57:16.325313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-831881cd-434d-4a7c-8495-e45286a95909 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:16.326112 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-831881cd-434d-4a7c-8495-e45286a95909 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:16.326897 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-831881cd-434d-4a7c-8495-e45286a95909 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:16.327340 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-831881cd-434d-4a7c-8495-e45286a95909 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:16.466787 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-831881cd-434d-4a7c-8495-e45286a95909 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:57:16.474352 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-831881cd-434d-4a7c-8495-e45286a95909 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1265 microversion: 2.1 time: 0.160682 May 10 17:57:16.474925 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 556/1101] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:57:16 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:57:17.492362 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-40983ff9-ce62-4717-943f-6e886c9f586e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:57:17.492981 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-40983ff9-ce62-4717-943f-6e886c9f586e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:57:17.499353 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-40983ff9-ce62-4717-943f-6e886c9f586e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:17.499840 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-40983ff9-ce62-4717-943f-6e886c9f586e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:17.500618 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-40983ff9-ce62-4717-943f-6e886c9f586e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:17.501059 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-40983ff9-ce62-4717-943f-6e886c9f586e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:17.639550 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-40983ff9-ce62-4717-943f-6e886c9f586e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:57:17.647416 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-40983ff9-ce62-4717-943f-6e886c9f586e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1265 microversion: 2.1 time: 0.158959 May 10 17:57:17.648109 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 546/1102] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:57:17 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:57:18.664203 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fd4739ae-d203-4f81-84fe-5da81bb0d228 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:57:18.664860 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-fd4739ae-d203-4f81-84fe-5da81bb0d228 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:57:18.671499 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fd4739ae-d203-4f81-84fe-5da81bb0d228 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:18.671950 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fd4739ae-d203-4f81-84fe-5da81bb0d228 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:18.672740 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fd4739ae-d203-4f81-84fe-5da81bb0d228 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:18.673176 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fd4739ae-d203-4f81-84fe-5da81bb0d228 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:18.805789 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fd4739ae-d203-4f81-84fe-5da81bb0d228 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:57:18.818110 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-fd4739ae-d203-4f81-84fe-5da81bb0d228 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1265 microversion: 2.1 time: 0.157547 May 10 17:57:18.818709 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 557/1103] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:57:18 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:57:19.835561 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6a1d8d26-ead1-42c6-8e00-758cdc1ff95c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:57:19.836274 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6a1d8d26-ead1-42c6-8e00-758cdc1ff95c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:57:19.842705 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6a1d8d26-ead1-42c6-8e00-758cdc1ff95c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:19.843155 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6a1d8d26-ead1-42c6-8e00-758cdc1ff95c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:19.844026 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6a1d8d26-ead1-42c6-8e00-758cdc1ff95c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:19.844561 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6a1d8d26-ead1-42c6-8e00-758cdc1ff95c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:20.008471 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-6a1d8d26-ead1-42c6-8e00-758cdc1ff95c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:57:20.021124 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6a1d8d26-ead1-42c6-8e00-758cdc1ff95c tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1265 microversion: 2.1 time: 0.189000 May 10 17:57:20.022155 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 547/1104] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:57:19 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:57:21.038469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b2fd70af-7dee-4047-b965-66b018b2d434 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:57:21.039046 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-b2fd70af-7dee-4047-b965-66b018b2d434 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:57:21.045827 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b2fd70af-7dee-4047-b965-66b018b2d434 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:21.046283 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b2fd70af-7dee-4047-b965-66b018b2d434 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:21.047067 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b2fd70af-7dee-4047-b965-66b018b2d434 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:21.047532 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b2fd70af-7dee-4047-b965-66b018b2d434 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:21.210959 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b2fd70af-7dee-4047-b965-66b018b2d434 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:57:21.220728 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b2fd70af-7dee-4047-b965-66b018b2d434 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1265 microversion: 2.1 time: 0.185977 May 10 17:57:21.221905 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 558/1105] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:57:21 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:57:22.239809 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2bc08631-2abf-4a3e-aa56-5e142b071272 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:57:22.240431 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2bc08631-2abf-4a3e-aa56-5e142b071272 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:57:22.246923 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2bc08631-2abf-4a3e-aa56-5e142b071272 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:22.247404 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2bc08631-2abf-4a3e-aa56-5e142b071272 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:22.248216 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2bc08631-2abf-4a3e-aa56-5e142b071272 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:22.248728 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2bc08631-2abf-4a3e-aa56-5e142b071272 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:22.382339 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2bc08631-2abf-4a3e-aa56-5e142b071272 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:57:22.390256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2bc08631-2abf-4a3e-aa56-5e142b071272 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1265 microversion: 2.1 time: 0.155142 May 10 17:57:22.390834 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 548/1106] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:57:22 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:57:23.408871 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bce7c886-49ea-4a86-bb8a-2908737dc647 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:57:23.409473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-976bdcb3-ea4b-4968-85d1-984212f28959 req-676b1d32-55e9-4944-9734-23ce9f84e912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10549f70-f1b2-414c-80e7-f79e0acb1ae1", "name": "network-vif-plugged", "status": "completed", "tag": "fb74e985-7afc-4d8a-a0ab-c3df196c6c97"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:57:23.410168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-bce7c886-49ea-4a86-bb8a-2908737dc647 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:57:23.416685 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bce7c886-49ea-4a86-bb8a-2908737dc647 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:23.417149 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bce7c886-49ea-4a86-bb8a-2908737dc647 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:23.417353 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-976bdcb3-ea4b-4968-85d1-984212f28959 req-676b1d32-55e9-4944-9734-23ce9f84e912 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:23.417801 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-976bdcb3-ea4b-4968-85d1-984212f28959 req-676b1d32-55e9-4944-9734-23ce9f84e912 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:23.417924 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bce7c886-49ea-4a86-bb8a-2908737dc647 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:23.418365 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bce7c886-49ea-4a86-bb8a-2908737dc647 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:23.430843 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-976bdcb3-ea4b-4968-85d1-984212f28959 req-676b1d32-55e9-4944-9734-23ce9f84e912 service nova] Creating event network-vif-plugged:fb74e985-7afc-4d8a-a0ab-c3df196c6c97 for instance 10549f70-f1b2-414c-80e7-f79e0acb1ae1 on hv-cinder-84130 May 10 17:57:23.437210 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-976bdcb3-ea4b-4968-85d1-984212f28959 req-676b1d32-55e9-4944-9734-23ce9f84e912 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215497 May 10 17:57:23.437813 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 559/1107] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:57:23.559640 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-bce7c886-49ea-4a86-bb8a-2908737dc647 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:57:23.567173 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bce7c886-49ea-4a86-bb8a-2908737dc647 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1265 microversion: 2.1 time: 0.162810 May 10 17:57:23.567798 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 549/1108] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:57:23 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:57:24.585878 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fc1b33d3-156d-4d60-806c-0d1c49622252 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:57:24.586592 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-fc1b33d3-156d-4d60-806c-0d1c49622252 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:57:24.593797 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fc1b33d3-156d-4d60-806c-0d1c49622252 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:24.594416 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fc1b33d3-156d-4d60-806c-0d1c49622252 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:24.595598 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fc1b33d3-156d-4d60-806c-0d1c49622252 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:24.596301 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fc1b33d3-156d-4d60-806c-0d1c49622252 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:24.728066 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fc1b33d3-156d-4d60-806c-0d1c49622252 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:57:24.735906 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-fc1b33d3-156d-4d60-806c-0d1c49622252 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1265 microversion: 2.1 time: 0.154842 May 10 17:57:24.736491 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 560/1109] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:57:24 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:57:25.753161 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-119ec050-792f-4360-8799-fa6bd87ea19b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:57:25.753771 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-119ec050-792f-4360-8799-fa6bd87ea19b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:57:25.760405 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-119ec050-792f-4360-8799-fa6bd87ea19b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:25.760844 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-119ec050-792f-4360-8799-fa6bd87ea19b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:25.761620 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-119ec050-792f-4360-8799-fa6bd87ea19b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:25.762061 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-119ec050-792f-4360-8799-fa6bd87ea19b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:25.894107 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-119ec050-792f-4360-8799-fa6bd87ea19b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:57:25.901698 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-119ec050-792f-4360-8799-fa6bd87ea19b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1265 microversion: 2.1 time: 0.152580 May 10 17:57:25.902278 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 550/1110] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:57:25 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:57:26.918132 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9bbdc6f2-a784-4db5-aa21-1e3368e32872 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:57:26.918770 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-9bbdc6f2-a784-4db5-aa21-1e3368e32872 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:57:26.925446 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9bbdc6f2-a784-4db5-aa21-1e3368e32872 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:26.925900 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9bbdc6f2-a784-4db5-aa21-1e3368e32872 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:26.926706 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9bbdc6f2-a784-4db5-aa21-1e3368e32872 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:26.927148 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9bbdc6f2-a784-4db5-aa21-1e3368e32872 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:27.058412 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-9bbdc6f2-a784-4db5-aa21-1e3368e32872 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:57:27.066580 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-9bbdc6f2-a784-4db5-aa21-1e3368e32872 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1452 microversion: 2.1 time: 0.152324 May 10 17:57:27.067154 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 561/1111] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:57:26 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:57:27.083011 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e5951526-6fd4-41e4-80ca-50e42995c687 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:57:27.083652 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e5951526-6fd4-41e4-80ca-50e42995c687 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:57:27.090303 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e5951526-6fd4-41e4-80ca-50e42995c687 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:27.090696 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e5951526-6fd4-41e4-80ca-50e42995c687 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:27.091499 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e5951526-6fd4-41e4-80ca-50e42995c687 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:27.091995 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e5951526-6fd4-41e4-80ca-50e42995c687 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:27.231298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e5951526-6fd4-41e4-80ca-50e42995c687 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:57:27.239021 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e5951526-6fd4-41e4-80ca-50e42995c687 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1452 microversion: 2.1 time: 0.159907 May 10 17:57:27.239633 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 551/1112] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:57:27 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:57:29.344098 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-d64b8a35-844f-4332-9446-e92a6c3323ef req-32704341-7de1-4b51-95fd-0a2afc19e780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10549f70-f1b2-414c-80e7-f79e0acb1ae1", "tag": "fb74e985-7afc-4d8a-a0ab-c3df196c6c97"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:57:29.352603 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-d64b8a35-844f-4332-9446-e92a6c3323ef req-32704341-7de1-4b51-95fd-0a2afc19e780 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:57:29.353046 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-d64b8a35-844f-4332-9446-e92a6c3323ef req-32704341-7de1-4b51-95fd-0a2afc19e780 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:57:29.365428 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-d64b8a35-844f-4332-9446-e92a6c3323ef req-32704341-7de1-4b51-95fd-0a2afc19e780 service nova] Creating event network-changed:fb74e985-7afc-4d8a-a0ab-c3df196c6c97 for instance 10549f70-f1b2-414c-80e7-f79e0acb1ae1 on hv-cinder-84130 May 10 17:57:29.370802 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-d64b8a35-844f-4332-9446-e92a6c3323ef req-32704341-7de1-4b51-95fd-0a2afc19e780 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031199 May 10 17:57:29.371644 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 562/1113] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:58:05.279069 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:58:05.279725 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Tue May 10 17:58:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:58:08.956729 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-af268b64-6b67-407f-bced-dfff9420caae tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:58:08.957802 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-af268b64-6b67-407f-bced-dfff9420caae tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:58:08.963904 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af268b64-6b67-407f-bced-dfff9420caae tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:08.964349 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af268b64-6b67-407f-bced-dfff9420caae tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:08.965140 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af268b64-6b67-407f-bced-dfff9420caae tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:08.965576 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af268b64-6b67-407f-bced-dfff9420caae tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:08.993879 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-af268b64-6b67-407f-bced-dfff9420caae tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042668 May 10 17:58:08.994359 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 552/1114] 10.222.0.60 () {58 vars in 1301 bytes} [Tue May 10 17:58:08 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 17:58:09.052686 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-92f99fad-8082-4b18-a4e6-5dc4134273d9 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:58:09.053265 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-92f99fad-8082-4b18-a4e6-5dc4134273d9 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:58:09.059475 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-92f99fad-8082-4b18-a4e6-5dc4134273d9 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:09.059925 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-92f99fad-8082-4b18-a4e6-5dc4134273d9 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:09.060686 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-92f99fad-8082-4b18-a4e6-5dc4134273d9 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:09.061124 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-92f99fad-8082-4b18-a4e6-5dc4134273d9 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:09.086635 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-92f99fad-8082-4b18-a4e6-5dc4134273d9 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Going to try to terminate instance {{(pid=123753) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:58:09.161178 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-92f99fad-8082-4b18-a4e6-5dc4134273d9 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 204 len: 0 microversion: 2.1 time: 0.113464 May 10 17:58:09.161826 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 563/1115] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:58:09 2022] DELETE /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:58:09.170588 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-85ff1c6e-baf2-41d5-abf7-4e153e4b4909 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:58:09.171224 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-85ff1c6e-baf2-41d5-abf7-4e153e4b4909 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:58:09.177910 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-85ff1c6e-baf2-41d5-abf7-4e153e4b4909 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:09.178369 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-85ff1c6e-baf2-41d5-abf7-4e153e4b4909 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:09.179139 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-85ff1c6e-baf2-41d5-abf7-4e153e4b4909 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:09.179605 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-85ff1c6e-baf2-41d5-abf7-4e153e4b4909 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:09.309089 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-85ff1c6e-baf2-41d5-abf7-4e153e4b4909 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:58:09.317175 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-85ff1c6e-baf2-41d5-abf7-4e153e4b4909 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1671 microversion: 2.1 time: 0.150585 May 10 17:58:09.317744 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 553/1116] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:58:09 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:58:10.335330 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-18d19aff-5a4e-447d-8421-2b1788054fe3 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:58:10.336148 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-18d19aff-5a4e-447d-8421-2b1788054fe3 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:58:10.342539 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-18d19aff-5a4e-447d-8421-2b1788054fe3 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:10.342987 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-18d19aff-5a4e-447d-8421-2b1788054fe3 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:10.343787 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-18d19aff-5a4e-447d-8421-2b1788054fe3 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:10.344323 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-18d19aff-5a4e-447d-8421-2b1788054fe3 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:10.475950 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-18d19aff-5a4e-447d-8421-2b1788054fe3 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:58:10.483382 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-18d19aff-5a4e-447d-8421-2b1788054fe3 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1671 microversion: 2.1 time: 0.152284 May 10 17:58:10.483952 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 564/1117] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:58:10 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:58:11.500755 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-829e7c4a-1be4-4ca6-8eec-a5234ecc108a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:58:11.501396 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-829e7c4a-1be4-4ca6-8eec-a5234ecc108a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:58:11.508047 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-829e7c4a-1be4-4ca6-8eec-a5234ecc108a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:11.508502 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-829e7c4a-1be4-4ca6-8eec-a5234ecc108a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:11.509287 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-829e7c4a-1be4-4ca6-8eec-a5234ecc108a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:11.509725 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-829e7c4a-1be4-4ca6-8eec-a5234ecc108a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:11.804999 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-829e7c4a-1be4-4ca6-8eec-a5234ecc108a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:58:11.815809 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-829e7c4a-1be4-4ca6-8eec-a5234ecc108a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 200 len: 1603 microversion: 2.1 time: 0.318732 May 10 17:58:11.816877 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 554/1118] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:58:11 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 1603 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:58:11.986093 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-a2cf2427-7088-4a91-8279-a521a426ff8e req-08e45a7a-6f7d-447f-9a6d-1649e4319345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f67aef06-0fe1-4ec5-a643-e51baea32b2e", "name": "network-vif-deleted", "tag": "b7f4dfb8-2c4d-4c91-8b1f-6040b097f331"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:58:11.996448 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-a2cf2427-7088-4a91-8279-a521a426ff8e req-08e45a7a-6f7d-447f-9a6d-1649e4319345 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:11.996986 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-a2cf2427-7088-4a91-8279-a521a426ff8e req-08e45a7a-6f7d-447f-9a6d-1649e4319345 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:12.010630 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-a2cf2427-7088-4a91-8279-a521a426ff8e req-08e45a7a-6f7d-447f-9a6d-1649e4319345 service nova] Creating event network-vif-deleted:b7f4dfb8-2c4d-4c91-8b1f-6040b097f331 for instance f67aef06-0fe1-4ec5-a643-e51baea32b2e on hv-cinder-84130 May 10 17:58:12.017421 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-a2cf2427-7088-4a91-8279-a521a426ff8e req-08e45a7a-6f7d-447f-9a6d-1649e4319345 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034606 May 10 17:58:12.018105 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 565/1119] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:58:12.837802 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e7236a9b-3c63-411c-b658-da2c0d4d7875 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:58:12.838429 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e7236a9b-3c63-411c-b658-da2c0d4d7875 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:58:12.853147 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7236a9b-3c63-411c-b658-da2c0d4d7875 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:12.853598 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7236a9b-3c63-411c-b658-da2c0d4d7875 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:12.854380 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7236a9b-3c63-411c-b658-da2c0d4d7875 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:12.854818 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e7236a9b-3c63-411c-b658-da2c0d4d7875 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:12.872048 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-e7236a9b-3c63-411c-b658-da2c0d4d7875 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] HTTP exception thrown: Instance f67aef06-0fe1-4ec5-a643-e51baea32b2e could not be found. May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e7236a9b-3c63-411c-b658-da2c0d4d7875 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Request method failure captured: May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e HTTP/1.1 May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqZjcgbeBwGH8870PXuS7YXTl04OcdcT45jTdBKbtTz4L_6Uye_AvJ9FJWIkWwdFspQ_Cmn4VEkRK723NNWLDPEkHusY8XLsz9B4Vl9fkIFrHc27k7uIUSComQ13jVFzdjj1MoEGHEKxYiLk72isKs4gLVB2-lcwhqPxP_Gk95afjTk May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: a83ced38e3ea471399fe49b3162b38e7 May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeTestJSON-185127037 May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:58:12.873895 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:58:12.875843 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a83ced38e3ea471399fe49b3162b38e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a83ced38e3ea471399fe49b3162b38e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a83ced38e3ea471399fe49b3162b38e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a83ced38e3ea471399fe49b3162b38e7"}]}] May 10 17:58:12.875843 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeTestJSON-185127037 May 10 17:58:12.875843 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: a83ced38e3ea471399fe49b3162b38e7 May 10 17:58:12.875843 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeTestJSON-185127037 May 10 17:58:12.875843 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeTestJSON-185127037-project May 10 17:58:12.875843 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:58:12.875843 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:58:12.875843 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: 6a1dcd8a84cf4f33b5405ad0279bf2b4 May 10 17:58:12.875843 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeTestJSON-185127037-project May 10 17:58:12.875843 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:58:12.875843 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance f67aef06-0fe1-4ec5-a643-e51baea32b2e could not be found. May 10 17:58:12.875843 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': 'f67aef06-0fe1-4ec5-a643-e51baea32b2e'} May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67aef06-0fe1-4ec5-a643-e51baea32b2e could not be found. May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:58:12.877415 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:58:12.882298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:58:12.882298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:58:12.882298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:58:12.882298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:58:12.882298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:58:12.882298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:58:12.882298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:58:12.882298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67aef06-0fe1-4ec5-a643-e51baea32b2e could not be found. May 10 17:58:12.882298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:58:12.882298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:58:12.882298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:58:12.882298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:58:12.882298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:58:12.882298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:58:12.882298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:58:12.882298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:58:12.882298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67aef06-0fe1-4ec5-a643-e51baea32b2e could not be found. May 10 17:58:12.882298 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:58:12.884000 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e7236a9b-3c63-411c-b658-da2c0d4d7875 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Returning 404 to user: Instance f67aef06-0fe1-4ec5-a643-e51baea32b2e could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:58:12.884000 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e7236a9b-3c63-411c-b658-da2c0d4d7875 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 404 len: 111 microversion: 2.1 time: 0.047508 May 10 17:58:12.884000 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 555/1120] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:58:12 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:58:12.887795 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-082a061e-79cb-4816-a824-e35b78515927 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '.version_select at 0x7f3e7b9eb8b0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:58:12.911690 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-082a061e-79cb-4816-a824-e35b78515927 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-734244225" status: 202 len: 0 microversion: 2.1 time: 0.028172 May 10 17:58:12.912384 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 566/1121] 10.222.0.60 () {58 vars in 1217 bytes} [Tue May 10 17:58:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-734244225 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:58:13.564345 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-07b697ea-4d5f-495b-974d-8b78d6fe596a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Action: 'create', calling method: .version_select at 0x7f3e7baf6430>, body: {"keypair": {"name": "tempest-keypair-1689162653", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD0JkT+xqe6lWBVRhPpsMjl9At71vGmZynV/0/VN4ZAgYq4yXSe9uu5kebx/FNzB5z1Ykf6aEhq2uybLuGuQ7+9y3C50rtQq12s5lTvR8KApTwx1jDBj5rb4Ij2PrYeGGQ=="}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:58:13.578398 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-07b697ea-4d5f-495b-974d-8b78d6fe596a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Getting quotas for project a83ced38e3ea471399fe49b3162b38e7. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:58:13.582179 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-07b697ea-4d5f-495b-974d-8b78d6fe596a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Getting quotas for user 6a1dcd8a84cf4f33b5405ad0279bf2b4 and project a83ced38e3ea471399fe49b3162b38e7. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:58:13.606976 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-07b697ea-4d5f-495b-974d-8b78d6fe596a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047119 May 10 17:58:13.607619 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 556/1122] 10.222.0.60 () {60 vars in 1158 bytes} [Tue May 10 17:58:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:58:14.810239 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1c6e1849-4256-49f8-b8a5-f1dafb421849 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-60817289", "imageRef": "a7737c62-8029-44aa-8da7-e46fea7607fb", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6723a7dd-891c-4580-9df3-21c9f6f08046"}], "security_groups": [{"name": "tempest-securitygroup--251794007"}], "key_name": "tempest-keypair-1689162653", "user_data": "}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:58:14.910313 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.network.neutron [None req-1c6e1849-4256-49f8-b8a5-f1dafb421849 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] validate_networks() for [('6723a7dd-891c-4580-9df3-21c9f6f08046', None, None, None, None, None)] {{(pid=123753) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 17:58:15.273908 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-1c6e1849-4256-49f8-b8a5-f1dafb421849 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Flavor limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 17:58:15.274374 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-1c6e1849-4256-49f8-b8a5-f1dafb421849 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Image limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 17:58:15.274912 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-1c6e1849-4256-49f8-b8a5-f1dafb421849 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Flavor pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 17:58:15.275328 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-1c6e1849-4256-49f8-b8a5-f1dafb421849 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Image pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 17:58:15.275773 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-1c6e1849-4256-49f8-b8a5-f1dafb421849 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 17:58:15.285537 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1c6e1849-4256-49f8-b8a5-f1dafb421849 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:15.285990 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1c6e1849-4256-49f8-b8a5-f1dafb421849 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:15.286798 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1c6e1849-4256-49f8-b8a5-f1dafb421849 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:15.287238 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1c6e1849-4256-49f8-b8a5-f1dafb421849 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:15.308695 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-1c6e1849-4256-49f8-b8a5-f1dafb421849 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Getting quotas for project a83ced38e3ea471399fe49b3162b38e7. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 17:58:15.313786 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-1c6e1849-4256-49f8-b8a5-f1dafb421849 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Getting quotas for user 6a1dcd8a84cf4f33b5405ad0279bf2b4 and project a83ced38e3ea471399fe49b3162b38e7. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 17:58:15.325534 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-1c6e1849-4256-49f8-b8a5-f1dafb421849 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Going to run 1 instances... {{(pid=123753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 17:58:15.328268 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-1c6e1849-4256-49f8-b8a5-f1dafb421849 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a7737c62-8029-44aa-8da7-e46fea7607fb',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 17:58:15.376351 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-1c6e1849-4256-49f8-b8a5-f1dafb421849 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.570874 May 10 17:58:15.377020 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 567/1123] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 17:58:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 17:58:15.387389 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-98093408-631c-4d21-aaa6-3f753a22bb56 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:58:15.387996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-98093408-631c-4d21-aaa6-3f753a22bb56 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:58:15.450896 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-98093408-631c-4d21-aaa6-3f753a22bb56 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:58:15.460886 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-98093408-631c-4d21-aaa6-3f753a22bb56 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81" status: 200 len: 1236 microversion: 2.1 time: 0.077806 May 10 17:58:15.461678 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 557/1124] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:58:15 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 => generated 1236 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:58:16.478284 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5184e29b-980d-4852-b20a-d3353760d355 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:58:16.479009 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5184e29b-980d-4852-b20a-d3353760d355 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:58:16.486504 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5184e29b-980d-4852-b20a-d3353760d355 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:16.486955 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5184e29b-980d-4852-b20a-d3353760d355 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:16.487749 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5184e29b-980d-4852-b20a-d3353760d355 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:16.488189 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5184e29b-980d-4852-b20a-d3353760d355 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:16.557320 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-5184e29b-980d-4852-b20a-d3353760d355 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:58:16.565945 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-5184e29b-980d-4852-b20a-d3353760d355 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81" status: 200 len: 1294 microversion: 2.1 time: 0.091883 May 10 17:58:16.567174 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 568/1125] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:58:16 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:58:17.584175 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-fac1d058-341e-4917-ad3c-3aed1853b745 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:58:17.584900 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-fac1d058-341e-4917-ad3c-3aed1853b745 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:58:17.592807 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fac1d058-341e-4917-ad3c-3aed1853b745 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:17.593737 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fac1d058-341e-4917-ad3c-3aed1853b745 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:17.594403 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fac1d058-341e-4917-ad3c-3aed1853b745 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:17.595387 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fac1d058-341e-4917-ad3c-3aed1853b745 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:17.792246 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-fac1d058-341e-4917-ad3c-3aed1853b745 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:58:17.800271 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-fac1d058-341e-4917-ad3c-3aed1853b745 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81" status: 200 len: 1361 microversion: 2.1 time: 0.220704 May 10 17:58:17.800847 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 558/1126] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:58:17 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:58:17.909284 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-989fc4f7-25ff-4eb7-b1a2-0440fc858164 req-2e8b4905-a229-46e6-b2d5-370cfe89785e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d20a5da-0117-4756-9702-78bf939f6f81", "tag": "cdf3d2c3-53c7-4f85-9104-e3ff4f413ee1"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:58:17.918481 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-989fc4f7-25ff-4eb7-b1a2-0440fc858164 req-2e8b4905-a229-46e6-b2d5-370cfe89785e service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:17.918943 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-989fc4f7-25ff-4eb7-b1a2-0440fc858164 req-2e8b4905-a229-46e6-b2d5-370cfe89785e service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:17.936380 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-989fc4f7-25ff-4eb7-b1a2-0440fc858164 req-2e8b4905-a229-46e6-b2d5-370cfe89785e service nova] Creating event network-changed:cdf3d2c3-53c7-4f85-9104-e3ff4f413ee1 for instance 4d20a5da-0117-4756-9702-78bf939f6f81 on hv-cinder-84130 May 10 17:58:17.942222 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-989fc4f7-25ff-4eb7-b1a2-0440fc858164 req-2e8b4905-a229-46e6-b2d5-370cfe89785e service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036651 May 10 17:58:17.943466 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 569/1127] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:58:18.817772 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-d55270e0-1e14-4754-ac9e-da3804d87a36 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:58:18.818386 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-d55270e0-1e14-4754-ac9e-da3804d87a36 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:58:18.824875 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d55270e0-1e14-4754-ac9e-da3804d87a36 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:18.825332 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d55270e0-1e14-4754-ac9e-da3804d87a36 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:18.826103 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d55270e0-1e14-4754-ac9e-da3804d87a36 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:18.826804 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-d55270e0-1e14-4754-ac9e-da3804d87a36 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:18.954978 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-d55270e0-1e14-4754-ac9e-da3804d87a36 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:58:18.962773 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-d55270e0-1e14-4754-ac9e-da3804d87a36 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81" status: 200 len: 1361 microversion: 2.1 time: 0.149591 May 10 17:58:18.963349 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 559/1128] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:58:18 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:58:19.980958 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8f314af9-e2a2-434e-9476-84340f7aebfe tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:58:19.981683 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8f314af9-e2a2-434e-9476-84340f7aebfe tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:58:19.987943 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8f314af9-e2a2-434e-9476-84340f7aebfe tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:19.988399 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8f314af9-e2a2-434e-9476-84340f7aebfe tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:19.989169 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8f314af9-e2a2-434e-9476-84340f7aebfe tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:19.989610 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8f314af9-e2a2-434e-9476-84340f7aebfe tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:20.121375 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-8f314af9-e2a2-434e-9476-84340f7aebfe tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:58:20.128747 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8f314af9-e2a2-434e-9476-84340f7aebfe tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81" status: 200 len: 1361 microversion: 2.1 time: 0.152459 May 10 17:58:20.129302 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 570/1129] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:58:19 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:58:21.145942 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0179fb3e-5381-4306-9805-56eb4eaca103 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:58:21.146526 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0179fb3e-5381-4306-9805-56eb4eaca103 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:58:21.153101 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0179fb3e-5381-4306-9805-56eb4eaca103 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:21.153557 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0179fb3e-5381-4306-9805-56eb4eaca103 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:21.154334 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0179fb3e-5381-4306-9805-56eb4eaca103 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:21.154778 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0179fb3e-5381-4306-9805-56eb4eaca103 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:21.287678 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0179fb3e-5381-4306-9805-56eb4eaca103 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:58:21.295050 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0179fb3e-5381-4306-9805-56eb4eaca103 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81" status: 200 len: 1361 microversion: 2.1 time: 0.153623 May 10 17:58:21.295648 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 560/1130] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:58:21 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:58:22.311572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-556d2d7b-b4d1-430d-951b-c4f7e6b29318 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:58:22.312235 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-556d2d7b-b4d1-430d-951b-c4f7e6b29318 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:58:22.318722 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-556d2d7b-b4d1-430d-951b-c4f7e6b29318 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:22.319173 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-556d2d7b-b4d1-430d-951b-c4f7e6b29318 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:22.319975 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-556d2d7b-b4d1-430d-951b-c4f7e6b29318 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:22.320414 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-556d2d7b-b4d1-430d-951b-c4f7e6b29318 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:22.450009 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-556d2d7b-b4d1-430d-951b-c4f7e6b29318 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:58:22.458105 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-556d2d7b-b4d1-430d-951b-c4f7e6b29318 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81" status: 200 len: 1361 microversion: 2.1 time: 0.150439 May 10 17:58:22.458664 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 571/1131] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:58:22 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:58:23.475269 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-556a7b51-4abc-4f2a-accc-9ee0b8f2e23d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:58:23.475948 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-556a7b51-4abc-4f2a-accc-9ee0b8f2e23d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:58:23.482450 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-556a7b51-4abc-4f2a-accc-9ee0b8f2e23d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:23.482899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-556a7b51-4abc-4f2a-accc-9ee0b8f2e23d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:23.483698 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-556a7b51-4abc-4f2a-accc-9ee0b8f2e23d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:23.484139 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-556a7b51-4abc-4f2a-accc-9ee0b8f2e23d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:23.505111 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-3a4b6ea7-6e7d-4f21-ae94-4f49a0b12d72 req-c19c2402-5791-42d1-bda0-b52f0b6ccb1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d20a5da-0117-4756-9702-78bf939f6f81", "name": "network-vif-plugged", "status": "completed", "tag": "cdf3d2c3-53c7-4f85-9104-e3ff4f413ee1"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:58:23.513986 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-3a4b6ea7-6e7d-4f21-ae94-4f49a0b12d72 req-c19c2402-5791-42d1-bda0-b52f0b6ccb1b service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:23.514443 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-3a4b6ea7-6e7d-4f21-ae94-4f49a0b12d72 req-c19c2402-5791-42d1-bda0-b52f0b6ccb1b service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:23.528116 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-3a4b6ea7-6e7d-4f21-ae94-4f49a0b12d72 req-c19c2402-5791-42d1-bda0-b52f0b6ccb1b service nova] Creating event network-vif-plugged:cdf3d2c3-53c7-4f85-9104-e3ff4f413ee1 for instance 4d20a5da-0117-4756-9702-78bf939f6f81 on hv-cinder-84130 May 10 17:58:23.533714 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-3a4b6ea7-6e7d-4f21-ae94-4f49a0b12d72 req-c19c2402-5791-42d1-bda0-b52f0b6ccb1b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032797 May 10 17:58:23.535459 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 572/1132] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:58:23.626381 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-556a7b51-4abc-4f2a-accc-9ee0b8f2e23d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:58:23.634402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-556a7b51-4abc-4f2a-accc-9ee0b8f2e23d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81" status: 200 len: 1361 microversion: 2.1 time: 0.163180 May 10 17:58:23.634985 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 561/1133] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:58:23 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:58:24.653157 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4dbb21c9-ee07-4e9e-a04e-779d98104996 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:58:24.653879 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4dbb21c9-ee07-4e9e-a04e-779d98104996 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:58:24.660125 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4dbb21c9-ee07-4e9e-a04e-779d98104996 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:24.660574 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4dbb21c9-ee07-4e9e-a04e-779d98104996 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:24.661399 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4dbb21c9-ee07-4e9e-a04e-779d98104996 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:24.661779 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4dbb21c9-ee07-4e9e-a04e-779d98104996 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:24.794247 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4dbb21c9-ee07-4e9e-a04e-779d98104996 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:58:24.802117 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4dbb21c9-ee07-4e9e-a04e-779d98104996 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81" status: 200 len: 1361 microversion: 2.1 time: 0.153681 May 10 17:58:24.802689 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 573/1134] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:58:24 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:58:25.059640 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:58:25.060176 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Tue May 10 17:58:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:58:25.818563 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a6a1b0d1-7372-45e8-96ef-818f553e5609 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:58:25.819414 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a6a1b0d1-7372-45e8-96ef-818f553e5609 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:58:25.825958 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a6a1b0d1-7372-45e8-96ef-818f553e5609 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:25.826626 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a6a1b0d1-7372-45e8-96ef-818f553e5609 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:25.827423 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a6a1b0d1-7372-45e8-96ef-818f553e5609 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:25.827875 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a6a1b0d1-7372-45e8-96ef-818f553e5609 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:25.959650 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a6a1b0d1-7372-45e8-96ef-818f553e5609 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:58:25.966910 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a6a1b0d1-7372-45e8-96ef-818f553e5609 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81" status: 200 len: 1546 microversion: 2.1 time: 0.152707 May 10 17:58:25.967481 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 562/1135] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:58:25 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:58:25.983491 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9c9a25fb-35dd-4d8b-a039-ff2b768b8039 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:58:25.984032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-9c9a25fb-35dd-4d8b-a039-ff2b768b8039 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:58:25.990651 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9c9a25fb-35dd-4d8b-a039-ff2b768b8039 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:25.991101 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9c9a25fb-35dd-4d8b-a039-ff2b768b8039 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:25.991904 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9c9a25fb-35dd-4d8b-a039-ff2b768b8039 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:25.992349 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9c9a25fb-35dd-4d8b-a039-ff2b768b8039 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:26.068942 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-9c9a25fb-35dd-4d8b-a039-ff2b768b8039 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089199 May 10 17:58:26.069636 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 574/1136] 10.222.0.60 () {58 vars in 1274 bytes} [Tue May 10 17:58:25 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:58:27.048327 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-ba67f17f-8ea8-4f76-9488-c4d5e575fc44 req-d4802a6d-eca7-45f1-97cc-9b89a04bc2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d20a5da-0117-4756-9702-78bf939f6f81", "tag": "cdf3d2c3-53c7-4f85-9104-e3ff4f413ee1"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:58:27.057369 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-ba67f17f-8ea8-4f76-9488-c4d5e575fc44 req-d4802a6d-eca7-45f1-97cc-9b89a04bc2b0 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:58:27.057892 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-ba67f17f-8ea8-4f76-9488-c4d5e575fc44 req-d4802a6d-eca7-45f1-97cc-9b89a04bc2b0 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:58:27.070137 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-ba67f17f-8ea8-4f76-9488-c4d5e575fc44 req-d4802a6d-eca7-45f1-97cc-9b89a04bc2b0 service nova] Creating event network-changed:cdf3d2c3-53c7-4f85-9104-e3ff4f413ee1 for instance 4d20a5da-0117-4756-9702-78bf939f6f81 on hv-cinder-84130 May 10 17:58:27.076930 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-ba67f17f-8ea8-4f76-9488-c4d5e575fc44 req-d4802a6d-eca7-45f1-97cc-9b89a04bc2b0 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031770 May 10 17:58:27.077585 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 563/1137] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:59:33.763273 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e81b9e67-254d-4ca9-9a7d-4b4a3baeade1 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:59:33.764100 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e81b9e67-254d-4ca9-9a7d-4b4a3baeade1 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:59:33.770599 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e81b9e67-254d-4ca9-9a7d-4b4a3baeade1 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:33.771049 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e81b9e67-254d-4ca9-9a7d-4b4a3baeade1 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:33.771845 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e81b9e67-254d-4ca9-9a7d-4b4a3baeade1 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:33.774199 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e81b9e67-254d-4ca9-9a7d-4b4a3baeade1 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:33.800816 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e81b9e67-254d-4ca9-9a7d-4b4a3baeade1 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Going to try to terminate instance {{(pid=123753) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:59:33.896370 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e81b9e67-254d-4ca9-9a7d-4b4a3baeade1 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "DELETE /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 204 len: 0 microversion: 2.1 time: 0.138109 May 10 17:59:33.900640 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 575/1138] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:59:33 2022] DELETE /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:59:33.906563 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-a8e77cac-484e-4b9a-948a-b923304cefb8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:59:33.907259 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-a8e77cac-484e-4b9a-948a-b923304cefb8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:59:33.914544 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a8e77cac-484e-4b9a-948a-b923304cefb8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:33.915010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a8e77cac-484e-4b9a-948a-b923304cefb8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:33.915828 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a8e77cac-484e-4b9a-948a-b923304cefb8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:33.916296 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-a8e77cac-484e-4b9a-948a-b923304cefb8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:33.931341 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-302ebf3d-e819-4a17-8463-0ff8448c6803 req-624b3946-6448-45a8-a64d-afba093b04fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10549f70-f1b2-414c-80e7-f79e0acb1ae1", "tag": "fb74e985-7afc-4d8a-a0ab-c3df196c6c97"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:59:33.939810 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-302ebf3d-e819-4a17-8463-0ff8448c6803 req-624b3946-6448-45a8-a64d-afba093b04fe service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:33.940258 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-302ebf3d-e819-4a17-8463-0ff8448c6803 req-624b3946-6448-45a8-a64d-afba093b04fe service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:33.954177 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-302ebf3d-e819-4a17-8463-0ff8448c6803 req-624b3946-6448-45a8-a64d-afba093b04fe service nova] Creating event network-changed:fb74e985-7afc-4d8a-a0ab-c3df196c6c97 for instance 10549f70-f1b2-414c-80e7-f79e0acb1ae1 on hv-cinder-84130 May 10 17:59:33.958754 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-302ebf3d-e819-4a17-8463-0ff8448c6803 req-624b3946-6448-45a8-a64d-afba093b04fe service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192790 May 10 17:59:33.962372 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 564/1139] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:59:34.160367 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-a8e77cac-484e-4b9a-948a-b923304cefb8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:59:34.168544 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-a8e77cac-484e-4b9a-948a-b923304cefb8 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1576 microversion: 2.1 time: 0.266802 May 10 17:59:34.169112 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 576/1140] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:59:33 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1576 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:59:35.188948 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-17959937-7c47-4ec7-a948-503ed1f848db tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:59:35.189637 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-17959937-7c47-4ec7-a948-503ed1f848db tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:59:35.196773 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-17959937-7c47-4ec7-a948-503ed1f848db tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:35.197223 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-17959937-7c47-4ec7-a948-503ed1f848db tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:35.198005 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-17959937-7c47-4ec7-a948-503ed1f848db tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:35.198441 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-17959937-7c47-4ec7-a948-503ed1f848db tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:35.387598 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-17959937-7c47-4ec7-a948-503ed1f848db tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:59:35.396466 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-17959937-7c47-4ec7-a948-503ed1f848db tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1576 microversion: 2.1 time: 0.212048 May 10 17:59:35.397055 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 565/1141] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:59:35 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1576 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:59:36.356474 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 17:59:36.357255 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Tue May 10 17:59:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 17:59:36.414383 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-c120941e-e993-488f-a682-317b0a40376e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:59:36.414975 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-c120941e-e993-488f-a682-317b0a40376e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:59:36.421369 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c120941e-e993-488f-a682-317b0a40376e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:36.421826 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c120941e-e993-488f-a682-317b0a40376e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:36.422769 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c120941e-e993-488f-a682-317b0a40376e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:36.423218 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-c120941e-e993-488f-a682-317b0a40376e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:36.491746 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-b74879f5-2273-4cf3-84f0-0bf7366fcb72 req-723f7701-efb1-4ce1-b9d6-4209d84c9b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10549f70-f1b2-414c-80e7-f79e0acb1ae1", "name": "network-vif-deleted", "tag": "fb74e985-7afc-4d8a-a0ab-c3df196c6c97"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:59:36.498231 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-c120941e-e993-488f-a682-317b0a40376e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:59:36.500781 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-b74879f5-2273-4cf3-84f0-0bf7366fcb72 req-723f7701-efb1-4ce1-b9d6-4209d84c9b35 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:36.501206 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-b74879f5-2273-4cf3-84f0-0bf7366fcb72 req-723f7701-efb1-4ce1-b9d6-4209d84c9b35 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:36.507816 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-c120941e-e993-488f-a682-317b0a40376e tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 200 len: 1391 microversion: 2.1 time: 0.097537 May 10 17:59:36.508529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 577/1142] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:59:36 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 1391 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:59:36.513545 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-b74879f5-2273-4cf3-84f0-0bf7366fcb72 req-723f7701-efb1-4ce1-b9d6-4209d84c9b35 service nova] Creating event network-vif-deleted:fb74e985-7afc-4d8a-a0ab-c3df196c6c97 for instance 10549f70-f1b2-414c-80e7-f79e0acb1ae1 on hv-cinder-84130 May 10 17:59:36.518867 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-b74879f5-2273-4cf3-84f0-0bf7366fcb72 req-723f7701-efb1-4ce1-b9d6-4209d84c9b35 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031376 May 10 17:59:36.519856 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 566/1143] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 17:59:37.524690 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2f37e14a-e60a-401a-a035-d62e4d8ae87b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:59:37.525409 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-2f37e14a-e60a-401a-a035-d62e4d8ae87b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 10549f70-f1b2-414c-80e7-f79e0acb1ae1] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:59:37.531535 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2f37e14a-e60a-401a-a035-d62e4d8ae87b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:37.532052 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2f37e14a-e60a-401a-a035-d62e4d8ae87b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:37.532761 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2f37e14a-e60a-401a-a035-d62e4d8ae87b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:37.533412 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-2f37e14a-e60a-401a-a035-d62e4d8ae87b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:37.546942 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-2f37e14a-e60a-401a-a035-d62e4d8ae87b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] HTTP exception thrown: Instance 10549f70-f1b2-414c-80e7-f79e0acb1ae1 could not be found. May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2f37e14a-e60a-401a-a035-d62e4d8ae87b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Request method failure captured: May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 HTTP/1.1 May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqX2EGk80YwhkNBYpzSvIMQDlPkJh100D9TDT1w2DEUzIDMrBqmbDvF6KnvwYIYO0Y1CU26jIcmR_hkcQ0d-kJ4iRTJRmMNzvaf4TN6EFrBlPqfdbSd6xyeO8cEnI5lWeIO3QBW0WsQetnCHuiOv9I1wG-8dMfGHVMO0AlhgW_IrrwM May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: c93f0e69798e491aba3c8cf1493c2733 May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-TestVolumeBootPattern-524323740 May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:59:37.548627 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:59:37.550356 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c93f0e69798e491aba3c8cf1493c2733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c93f0e69798e491aba3c8cf1493c2733"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c93f0e69798e491aba3c8cf1493c2733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c93f0e69798e491aba3c8cf1493c2733"}]}] May 10 17:59:37.550356 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-TestVolumeBootPattern-524323740 May 10 17:59:37.550356 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: c93f0e69798e491aba3c8cf1493c2733 May 10 17:59:37.550356 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-TestVolumeBootPattern-524323740 May 10 17:59:37.550356 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-TestVolumeBootPattern-524323740-project May 10 17:59:37.550356 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:59:37.550356 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:59:37.550356 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: 798edb753845410fa6f9c136b43abf05 May 10 17:59:37.550356 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-TestVolumeBootPattern-524323740-project May 10 17:59:37.550356 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:59:37.550356 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance 10549f70-f1b2-414c-80e7-f79e0acb1ae1 could not be found. May 10 17:59:37.550356 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': '10549f70-f1b2-414c-80e7-f79e0acb1ae1'} May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10549f70-f1b2-414c-80e7-f79e0acb1ae1 could not be found. May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:59:37.551337 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:59:37.552915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:59:37.552915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:59:37.552915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:59:37.552915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:59:37.552915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:59:37.552915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:59:37.552915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:59:37.552915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10549f70-f1b2-414c-80e7-f79e0acb1ae1 could not be found. May 10 17:59:37.552915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:59:37.552915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:59:37.552915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:59:37.552915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:59:37.552915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:59:37.552915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:59:37.552915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:59:37.552915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:59:37.552915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10549f70-f1b2-414c-80e7-f79e0acb1ae1 could not be found. May 10 17:59:37.552915 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:59:37.554620 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-2f37e14a-e60a-401a-a035-d62e4d8ae87b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Returning 404 to user: Instance 10549f70-f1b2-414c-80e7-f79e0acb1ae1 could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:59:37.554620 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-2f37e14a-e60a-401a-a035-d62e4d8ae87b tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1" status: 404 len: 111 microversion: 2.1 time: 0.029850 May 10 17:59:37.554620 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 578/1144] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:59:37 2022] GET /compute/v2.1/servers/10549f70-f1b2-414c-80e7-f79e0acb1ae1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:59:40.869102 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0817d82a-7a10-450d-9fdb-9634619d2c01 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:59:40.869678 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0817d82a-7a10-450d-9fdb-9634619d2c01 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:59:40.870443 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-a970b891-c1c8-48af-9ab8-21238840abea req-c271e716-16f3-4423-8cc1-d9aacd992417 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b778e508-4f5a-4514-babe-5f0868a5d485", "tag": "ede42f21-9c07-4946-b657-fdd16056f502"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:59:40.876900 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0817d82a-7a10-450d-9fdb-9634619d2c01 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:40.877352 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0817d82a-7a10-450d-9fdb-9634619d2c01 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:40.878361 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0817d82a-7a10-450d-9fdb-9634619d2c01 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:40.879022 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-a970b891-c1c8-48af-9ab8-21238840abea req-c271e716-16f3-4423-8cc1-d9aacd992417 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:40.879183 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0817d82a-7a10-450d-9fdb-9634619d2c01 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:40.879532 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-a970b891-c1c8-48af-9ab8-21238840abea req-c271e716-16f3-4423-8cc1-d9aacd992417 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:40.891242 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-a970b891-c1c8-48af-9ab8-21238840abea req-c271e716-16f3-4423-8cc1-d9aacd992417 service nova] Creating event network-changed:ede42f21-9c07-4946-b657-fdd16056f502 for instance b778e508-4f5a-4514-babe-5f0868a5d485 on hv-cinder-84130 May 10 17:59:40.900631 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-a970b891-c1c8-48af-9ab8-21238840abea req-c271e716-16f3-4423-8cc1-d9aacd992417 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033836 May 10 17:59:40.901456 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 579/1145] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:59:40.906518 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0817d82a-7a10-450d-9fdb-9634619d2c01 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 17:59:41.006483 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0817d82a-7a10-450d-9fdb-9634619d2c01 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "DELETE /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 204 len: 0 microversion: 2.1 time: 0.141813 May 10 17:59:41.012748 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 567/1146] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:59:40 2022] DELETE /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 17:59:41.019216 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-40c7b295-8157-4f32-b787-0dae26f16df9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:59:41.019961 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-40c7b295-8157-4f32-b787-0dae26f16df9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:59:41.026992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-40c7b295-8157-4f32-b787-0dae26f16df9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:41.027477 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-40c7b295-8157-4f32-b787-0dae26f16df9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:41.028259 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-40c7b295-8157-4f32-b787-0dae26f16df9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:41.028889 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-40c7b295-8157-4f32-b787-0dae26f16df9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:41.168186 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-40c7b295-8157-4f32-b787-0dae26f16df9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:59:41.175576 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-40c7b295-8157-4f32-b787-0dae26f16df9 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1575 microversion: 2.1 time: 0.161108 May 10 17:59:41.176144 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 580/1147] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:59:41 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:59:42.001827 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b93120b4-8b4b-45cb-8209-0540d383c36c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:59:42.002498 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b93120b4-8b4b-45cb-8209-0540d383c36c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:59:42.009243 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b93120b4-8b4b-45cb-8209-0540d383c36c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:42.009697 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b93120b4-8b4b-45cb-8209-0540d383c36c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:42.010546 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b93120b4-8b4b-45cb-8209-0540d383c36c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:42.010994 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b93120b4-8b4b-45cb-8209-0540d383c36c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:42.038331 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b93120b4-8b4b-45cb-8209-0540d383c36c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/ips" status: 200 len: 145 microversion: 2.1 time: 0.040670 May 10 17:59:42.039444 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 568/1148] 10.222.0.60 () {58 vars in 1247 bytes} [Tue May 10 17:59:41 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:59:42.193067 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8187374e-2efb-4dc3-a1a7-4430e051a816 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:59:42.193687 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8187374e-2efb-4dc3-a1a7-4430e051a816 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:59:42.200342 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8187374e-2efb-4dc3-a1a7-4430e051a816 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:42.200790 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8187374e-2efb-4dc3-a1a7-4430e051a816 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:42.201563 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8187374e-2efb-4dc3-a1a7-4430e051a816 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:42.202351 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8187374e-2efb-4dc3-a1a7-4430e051a816 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:42.357102 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-8187374e-2efb-4dc3-a1a7-4430e051a816 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:59:42.364840 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8187374e-2efb-4dc3-a1a7-4430e051a816 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1457 microversion: 2.1 time: 0.175670 May 10 17:59:42.365418 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 581/1149] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:59:42 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1457 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 17:59:42.916070 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-25d44c58-0cd7-4e26-86a6-322f8cdf0eab req-04ac31f1-7d39-4135-8b61-5445a833a0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b778e508-4f5a-4514-babe-5f0868a5d485", "name": "network-vif-deleted", "tag": "ede42f21-9c07-4946-b657-fdd16056f502"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:59:42.924026 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-25d44c58-0cd7-4e26-86a6-322f8cdf0eab req-04ac31f1-7d39-4135-8b61-5445a833a0e6 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:42.924470 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-25d44c58-0cd7-4e26-86a6-322f8cdf0eab req-04ac31f1-7d39-4135-8b61-5445a833a0e6 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:42.935169 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-25d44c58-0cd7-4e26-86a6-322f8cdf0eab req-04ac31f1-7d39-4135-8b61-5445a833a0e6 service nova] Creating event network-vif-deleted:ede42f21-9c07-4946-b657-fdd16056f502 for instance b778e508-4f5a-4514-babe-5f0868a5d485 on hv-cinder-84130 May 10 17:59:42.940114 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-25d44c58-0cd7-4e26-86a6-322f8cdf0eab req-04ac31f1-7d39-4135-8b61-5445a833a0e6 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027704 May 10 17:59:42.940749 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 569/1150] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 17:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:59:43.368320 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-3c95dcae-fb76-4e06-96d0-a21d278d9bd0 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a6699754-d7a6-48e7-bea4-747f54c3bee4"}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:59:43.369393 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-3c95dcae-fb76-4e06-96d0-a21d278d9bd0 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:59:43.375838 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3c95dcae-fb76-4e06-96d0-a21d278d9bd0 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:43.376315 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3c95dcae-fb76-4e06-96d0-a21d278d9bd0 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:43.377204 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3c95dcae-fb76-4e06-96d0-a21d278d9bd0 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:43.377650 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3c95dcae-fb76-4e06-96d0-a21d278d9bd0 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:43.383165 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-a3c233b0-a45e-45ce-853b-1ba201af576f tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:59:43.384768 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-a3c233b0-a45e-45ce-853b-1ba201af576f tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:59:43.391429 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a3c233b0-a45e-45ce-853b-1ba201af576f tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:43.391881 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a3c233b0-a45e-45ce-853b-1ba201af576f tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:43.393232 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a3c233b0-a45e-45ce-853b-1ba201af576f tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:43.393232 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a3c233b0-a45e-45ce-853b-1ba201af576f tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:43.428299 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a3c233b0-a45e-45ce-853b-1ba201af576f tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:43.428760 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-a3c233b0-a45e-45ce-853b-1ba201af576f tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:43.429211 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.objects.instance [None req-a3c233b0-a45e-45ce-853b-1ba201af576f tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lazy-loading 'fault' on Instance uuid b778e508-4f5a-4514-babe-5f0868a5d485 {{(pid=123752) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 17:59:43.521458 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-a3c233b0-a45e-45ce-853b-1ba201af576f tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '798edb753845410fa6f9c136b43abf05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c93f0e69798e491aba3c8cf1493c2733', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 17:59:43.528951 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-a3c233b0-a45e-45ce-853b-1ba201af576f tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 200 len: 1230 microversion: 2.1 time: 0.150573 May 10 17:59:43.529515 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 570/1151] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:59:43 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 1230 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 17:59:43.848903 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-3c95dcae-fb76-4e06-96d0-a21d278d9bd0 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "POST /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.485200 May 10 17:59:43.849485 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 582/1152] 10.222.0.60 () {60 vars in 1322 bytes} [Tue May 10 17:59:43 2022] POST /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments => generated 194 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:59:44.545745 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-803cbc2a-5bbd-4aa4-8b0c-88d292661c3a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:59:44.546335 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-803cbc2a-5bbd-4aa4-8b0c-88d292661c3a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: b778e508-4f5a-4514-babe-5f0868a5d485] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:59:44.552696 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-803cbc2a-5bbd-4aa4-8b0c-88d292661c3a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:44.553152 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-803cbc2a-5bbd-4aa4-8b0c-88d292661c3a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:44.553929 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-803cbc2a-5bbd-4aa4-8b0c-88d292661c3a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:44.554900 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-803cbc2a-5bbd-4aa4-8b0c-88d292661c3a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:44.568689 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-803cbc2a-5bbd-4aa4-8b0c-88d292661c3a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] HTTP exception thrown: Instance b778e508-4f5a-4514-babe-5f0868a5d485 could not be found. May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-803cbc2a-5bbd-4aa4-8b0c-88d292661c3a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Request method failure captured: May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 HTTP/1.1 May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqX2EGk80YwhkNBYpzSvIMQDlPkJh100D9TDT1w2DEUzIDMrBqmbDvF6KnvwYIYO0Y1CU26jIcmR_hkcQ0d-kJ4iRTJRmMNzvaf4TN6EFrBlPqfdbSd6xyeO8cEnI5lWeIO3QBW0WsQetnCHuiOv9I1wG-8dMfGHVMO0AlhgW_IrrwM May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: c93f0e69798e491aba3c8cf1493c2733 May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-TestVolumeBootPattern-524323740 May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:59:44.570907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:59:44.572841 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c93f0e69798e491aba3c8cf1493c2733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c93f0e69798e491aba3c8cf1493c2733"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c93f0e69798e491aba3c8cf1493c2733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c93f0e69798e491aba3c8cf1493c2733"}]}] May 10 17:59:44.572841 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-TestVolumeBootPattern-524323740 May 10 17:59:44.572841 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: c93f0e69798e491aba3c8cf1493c2733 May 10 17:59:44.572841 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-TestVolumeBootPattern-524323740 May 10 17:59:44.572841 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-TestVolumeBootPattern-524323740-project May 10 17:59:44.572841 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:59:44.572841 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:59:44.572841 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: 798edb753845410fa6f9c136b43abf05 May 10 17:59:44.572841 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-TestVolumeBootPattern-524323740-project May 10 17:59:44.572841 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:59:44.572841 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance b778e508-4f5a-4514-babe-5f0868a5d485 could not be found. May 10 17:59:44.572841 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': 'b778e508-4f5a-4514-babe-5f0868a5d485'} May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b778e508-4f5a-4514-babe-5f0868a5d485 could not be found. May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:59:44.573656 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:59:44.574996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:59:44.574996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:59:44.574996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:59:44.574996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:59:44.574996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:59:44.574996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:59:44.574996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:59:44.574996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b778e508-4f5a-4514-babe-5f0868a5d485 could not be found. May 10 17:59:44.574996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:59:44.574996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:59:44.574996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:59:44.574996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:59:44.574996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:59:44.574996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:59:44.574996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:59:44.574996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:59:44.574996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b778e508-4f5a-4514-babe-5f0868a5d485 could not be found. May 10 17:59:44.574996 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:59:44.576216 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-803cbc2a-5bbd-4aa4-8b0c-88d292661c3a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Returning 404 to user: Instance b778e508-4f5a-4514-babe-5f0868a5d485 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:59:44.576216 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-803cbc2a-5bbd-4aa4-8b0c-88d292661c3a tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485" status: 404 len: 111 microversion: 2.1 time: 0.030625 May 10 17:59:44.576216 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 571/1153] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:59:44 2022] GET /compute/v2.1/servers/b778e508-4f5a-4514-babe-5f0868a5d485 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:59:45.041041 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1d1a0f49-6284-463b-81fc-9fe7c9423d53 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:59:45.041626 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-1d1a0f49-6284-463b-81fc-9fe7c9423d53 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:59:45.047881 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1d1a0f49-6284-463b-81fc-9fe7c9423d53 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:45.048331 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1d1a0f49-6284-463b-81fc-9fe7c9423d53 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:45.049090 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1d1a0f49-6284-463b-81fc-9fe7c9423d53 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:45.049525 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1d1a0f49-6284-463b-81fc-9fe7c9423d53 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:45.065093 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-1d1a0f49-6284-463b-81fc-9fe7c9423d53 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] HTTP exception thrown: Instance 55760f67-2403-45c9-8db7-d5ae5f45c366 could not be found. May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1d1a0f49-6284-463b-81fc-9fe7c9423d53 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Request method failure captured: May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: DELETE /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 HTTP/1.1 May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqX2EGk80YwhkNBYpzSvIMQDlPkJh100D9TDT1w2DEUzIDMrBqmbDvF6KnvwYIYO0Y1CU26jIcmR_hkcQ0d-kJ4iRTJRmMNzvaf4TN6EFrBlPqfdbSd6xyeO8cEnI5lWeIO3QBW0WsQetnCHuiOv9I1wG-8dMfGHVMO0AlhgW_IrrwM May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: c93f0e69798e491aba3c8cf1493c2733 May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-TestVolumeBootPattern-524323740 May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 17:59:45.066720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 17:59:45.068417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c93f0e69798e491aba3c8cf1493c2733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c93f0e69798e491aba3c8cf1493c2733"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c93f0e69798e491aba3c8cf1493c2733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c93f0e69798e491aba3c8cf1493c2733"}]}] May 10 17:59:45.068417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-TestVolumeBootPattern-524323740 May 10 17:59:45.068417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: c93f0e69798e491aba3c8cf1493c2733 May 10 17:59:45.068417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-TestVolumeBootPattern-524323740 May 10 17:59:45.068417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-TestVolumeBootPattern-524323740-project May 10 17:59:45.068417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 17:59:45.068417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 17:59:45.068417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: 798edb753845410fa6f9c136b43abf05 May 10 17:59:45.068417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-TestVolumeBootPattern-524323740-project May 10 17:59:45.068417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 17:59:45.068417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance 55760f67-2403-45c9-8db7-d5ae5f45c366 could not be found. May 10 17:59:45.068417 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': '55760f67-2403-45c9-8db7-d5ae5f45c366'} May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55760f67-2403-45c9-8db7-d5ae5f45c366 could not be found. May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:59:45.069282 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55760f67-2403-45c9-8db7-d5ae5f45c366 could not be found. May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55760f67-2403-45c9-8db7-d5ae5f45c366 could not be found. May 10 17:59:45.070808 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 17:59:45.072666 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1d1a0f49-6284-463b-81fc-9fe7c9423d53 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Returning 404 to user: Instance 55760f67-2403-45c9-8db7-d5ae5f45c366 could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:59:45.072666 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-1d1a0f49-6284-463b-81fc-9fe7c9423d53 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "DELETE /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 404 len: 111 microversion: 2.1 time: 0.032588 May 10 17:59:45.072666 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 583/1154] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 17:59:45 2022] DELETE /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:59:45.076875 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-25220516-4ac3-47da-a288-55647b84a4d4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:59:45.077752 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-25220516-4ac3-47da-a288-55647b84a4d4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] [instance: 55760f67-2403-45c9-8db7-d5ae5f45c366] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:59:45.083624 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-25220516-4ac3-47da-a288-55647b84a4d4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:45.084073 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-25220516-4ac3-47da-a288-55647b84a4d4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:45.084836 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-25220516-4ac3-47da-a288-55647b84a4d4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:45.085271 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-25220516-4ac3-47da-a288-55647b84a4d4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:45.098502 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-25220516-4ac3-47da-a288-55647b84a4d4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] HTTP exception thrown: Instance 55760f67-2403-45c9-8db7-d5ae5f45c366 could not be found. May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-25220516-4ac3-47da-a288-55647b84a4d4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Request method failure captured: May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 HTTP/1.1 May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqX2EGk80YwhkNBYpzSvIMQDlPkJh100D9TDT1w2DEUzIDMrBqmbDvF6KnvwYIYO0Y1CU26jIcmR_hkcQ0d-kJ4iRTJRmMNzvaf4TN6EFrBlPqfdbSd6xyeO8cEnI5lWeIO3QBW0WsQetnCHuiOv9I1wG-8dMfGHVMO0AlhgW_IrrwM May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: c93f0e69798e491aba3c8cf1493c2733 May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-TestVolumeBootPattern-524323740 May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 17:59:45.099956 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 17:59:45.102083 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c93f0e69798e491aba3c8cf1493c2733"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/c93f0e69798e491aba3c8cf1493c2733"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_c93f0e69798e491aba3c8cf1493c2733"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/c93f0e69798e491aba3c8cf1493c2733"}]}] May 10 17:59:45.102083 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-TestVolumeBootPattern-524323740 May 10 17:59:45.102083 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: c93f0e69798e491aba3c8cf1493c2733 May 10 17:59:45.102083 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-TestVolumeBootPattern-524323740 May 10 17:59:45.102083 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-TestVolumeBootPattern-524323740-project May 10 17:59:45.102083 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 17:59:45.102083 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 17:59:45.102083 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: 798edb753845410fa6f9c136b43abf05 May 10 17:59:45.102083 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-TestVolumeBootPattern-524323740-project May 10 17:59:45.102083 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 17:59:45.102083 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance 55760f67-2403-45c9-8db7-d5ae5f45c366 could not be found. May 10 17:59:45.102083 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': '55760f67-2403-45c9-8db7-d5ae5f45c366'} May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55760f67-2403-45c9-8db7-d5ae5f45c366 could not be found. May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 17:59:45.102954 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 17:59:45.104573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 17:59:45.104573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 17:59:45.104573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 17:59:45.104573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 17:59:45.104573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 17:59:45.104573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 17:59:45.104573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 17:59:45.104573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55760f67-2403-45c9-8db7-d5ae5f45c366 could not be found. May 10 17:59:45.104573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:59:45.104573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 17:59:45.104573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:59:45.104573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 17:59:45.104573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 17:59:45.104573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 17:59:45.104573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 17:59:45.104573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 17:59:45.104573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55760f67-2403-45c9-8db7-d5ae5f45c366 could not be found. May 10 17:59:45.104573 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 17:59:45.105849 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-25220516-4ac3-47da-a288-55647b84a4d4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Returning 404 to user: Instance 55760f67-2403-45c9-8db7-d5ae5f45c366 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 17:59:45.105849 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-25220516-4ac3-47da-a288-55647b84a4d4 tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366" status: 404 len: 111 microversion: 2.1 time: 0.028239 May 10 17:59:45.105849 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 572/1155] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 17:59:45 2022] GET /compute/v2.1/servers/55760f67-2403-45c9-8db7-d5ae5f45c366 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 17:59:46.384624 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-eafa32c2-3ffa-4f69-a5ea-4ccafa1760dc tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] Calling method '.version_select at 0x7f3e7bab9af0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:59:46.405653 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-eafa32c2-3ffa-4f69-a5ea-4ccafa1760dc tempest-TestVolumeBootPattern-524323740 tempest-TestVolumeBootPattern-524323740-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-630683051" status: 202 len: 0 microversion: 2.1 time: 0.025716 May 10 17:59:46.406245 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 584/1156] 10.222.0.60 () {58 vars in 1259 bytes} [Tue May 10 17:59:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-630683051 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 17:59:51.356849 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-5aaf90bc-6b15-4921-ac7b-018d0e7645b2 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:59:51.357794 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-5aaf90bc-6b15-4921-ac7b-018d0e7645b2 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:59:51.365019 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5aaf90bc-6b15-4921-ac7b-018d0e7645b2 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:51.365402 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5aaf90bc-6b15-4921-ac7b-018d0e7645b2 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:51.366189 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5aaf90bc-6b15-4921-ac7b-018d0e7645b2 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:51.366625 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-5aaf90bc-6b15-4921-ac7b-018d0e7645b2 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:51.400012 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-5aaf90bc-6b15-4921-ac7b-018d0e7645b2 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047141 May 10 17:59:51.400657 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 573/1157] 10.222.0.60 () {58 vars in 1301 bytes} [Tue May 10 17:59:51 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:59:51.411630 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-ffba4143-d974-4620-90be-45006835eb4e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 17:59:51.412174 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-ffba4143-d974-4620-90be-45006835eb4e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:59:51.421457 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ffba4143-d974-4620-90be-45006835eb4e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:51.421917 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ffba4143-d974-4620-90be-45006835eb4e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:51.422712 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ffba4143-d974-4620-90be-45006835eb4e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:51.423153 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-ffba4143-d974-4620-90be-45006835eb4e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:51.453541 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-ffba4143-d974-4620-90be-45006835eb4e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments/a6699754-d7a6-48e7-bea4-747f54c3bee4" status: 200 len: 194 microversion: 2.1 time: 0.046717 May 10 17:59:51.454271 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 585/1158] 10.222.0.60 () {58 vars in 1412 bytes} [Tue May 10 17:59:51 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments/a6699754-d7a6-48e7-bea4-747f54c3bee4 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 17:59:52.846815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-871e3c7f-d084-498d-a0f5-1bb0ba292ff1 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c925312-07a5-47fe-8efa-91771a1a7a34"}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 17:59:52.848271 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-871e3c7f-d084-498d-a0f5-1bb0ba292ff1 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 17:59:52.856612 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-871e3c7f-d084-498d-a0f5-1bb0ba292ff1 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:52.857076 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-871e3c7f-d084-498d-a0f5-1bb0ba292ff1 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:52.857868 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-871e3c7f-d084-498d-a0f5-1bb0ba292ff1 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 17:59:52.858346 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-871e3c7f-d084-498d-a0f5-1bb0ba292ff1 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 17:59:53.347052 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-871e3c7f-d084-498d-a0f5-1bb0ba292ff1 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "POST /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.504308 May 10 17:59:53.352726 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 574/1159] 10.222.0.60 () {60 vars in 1322 bytes} [Tue May 10 17:59:52 2022] POST /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments => generated 194 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 18:00:00.846458 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-39f3f28e-126f-4177-b919-e6ee8ca69562 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:00:00.847473 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-39f3f28e-126f-4177-b919-e6ee8ca69562 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:00:00.853761 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-39f3f28e-126f-4177-b919-e6ee8ca69562 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:00.854786 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-39f3f28e-126f-4177-b919-e6ee8ca69562 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:00.855559 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-39f3f28e-126f-4177-b919-e6ee8ca69562 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:00.855998 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-39f3f28e-126f-4177-b919-e6ee8ca69562 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:00.889323 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-39f3f28e-126f-4177-b919-e6ee8ca69562 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046906 May 10 18:00:00.889874 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 586/1160] 10.222.0.60 () {58 vars in 1301 bytes} [Tue May 10 18:00:00 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 18:00:01.033300 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-fe3090fc-b340-4080-a15d-2b3b76120636 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:00:01.033882 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-fe3090fc-b340-4080-a15d-2b3b76120636 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:00:01.040151 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fe3090fc-b340-4080-a15d-2b3b76120636 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:01.040607 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fe3090fc-b340-4080-a15d-2b3b76120636 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:01.041388 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fe3090fc-b340-4080-a15d-2b3b76120636 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:01.041919 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-fe3090fc-b340-4080-a15d-2b3b76120636 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:01.070190 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-fe3090fc-b340-4080-a15d-2b3b76120636 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments/a6699754-d7a6-48e7-bea4-747f54c3bee4" status: 200 len: 194 microversion: 2.1 time: 0.042436 May 10 18:00:01.070759 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 575/1161] 10.222.0.60 () {58 vars in 1412 bytes} [Tue May 10 18:00:01 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments/a6699754-d7a6-48e7-bea4-747f54c3bee4 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 18:00:01.081546 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-0cada1c2-cd19-4445-b116-4146d424d90c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:00:01.082065 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-0cada1c2-cd19-4445-b116-4146d424d90c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:00:01.088060 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0cada1c2-cd19-4445-b116-4146d424d90c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:01.088536 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0cada1c2-cd19-4445-b116-4146d424d90c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:01.089342 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0cada1c2-cd19-4445-b116-4146d424d90c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:01.089778 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0cada1c2-cd19-4445-b116-4146d424d90c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:01.167608 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.objects.instance [None req-0cada1c2-cd19-4445-b116-4146d424d90c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lazy-loading 'services' on Instance uuid 4d20a5da-0117-4756-9702-78bf939f6f81 {{(pid=123753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 18:00:01.236220 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-0cada1c2-cd19-4445-b116-4146d424d90c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments/a6699754-d7a6-48e7-bea4-747f54c3bee4" status: 202 len: 0 microversion: 2.1 time: 0.159608 May 10 18:00:01.236809 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 587/1162] 10.222.0.60 () {58 vars in 1415 bytes} [Tue May 10 18:00:01 2022] DELETE /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments/a6699754-d7a6-48e7-bea4-747f54c3bee4 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 18:00:02.352371 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-280d6f5e-a3ed-4544-92db-95ea59579dcb tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:00:02.352946 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-280d6f5e-a3ed-4544-92db-95ea59579dcb tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:00:02.360120 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-280d6f5e-a3ed-4544-92db-95ea59579dcb tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:02.360569 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-280d6f5e-a3ed-4544-92db-95ea59579dcb tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:02.361355 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-280d6f5e-a3ed-4544-92db-95ea59579dcb tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:02.361789 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-280d6f5e-a3ed-4544-92db-95ea59579dcb tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:02.398601 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-280d6f5e-a3ed-4544-92db-95ea59579dcb tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments/9c925312-07a5-47fe-8efa-91771a1a7a34" status: 200 len: 194 microversion: 2.1 time: 0.050290 May 10 18:00:02.399198 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 576/1163] 10.222.0.60 () {58 vars in 1412 bytes} [Tue May 10 18:00:02 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments/9c925312-07a5-47fe-8efa-91771a1a7a34 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 18:00:02.410823 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-744632c4-50f8-4fcb-a866-f78c5f7653b5 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:00:02.411413 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-744632c4-50f8-4fcb-a866-f78c5f7653b5 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:00:02.417722 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-744632c4-50f8-4fcb-a866-f78c5f7653b5 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:02.418315 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-744632c4-50f8-4fcb-a866-f78c5f7653b5 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:02.419186 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-744632c4-50f8-4fcb-a866-f78c5f7653b5 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:02.419717 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-744632c4-50f8-4fcb-a866-f78c5f7653b5 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:02.502325 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.objects.instance [None req-744632c4-50f8-4fcb-a866-f78c5f7653b5 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lazy-loading 'services' on Instance uuid 4d20a5da-0117-4756-9702-78bf939f6f81 {{(pid=123753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 18:00:02.572223 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-744632c4-50f8-4fcb-a866-f78c5f7653b5 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments/9c925312-07a5-47fe-8efa-91771a1a7a34" status: 202 len: 0 microversion: 2.1 time: 0.165984 May 10 18:00:02.573859 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 588/1164] 10.222.0.60 () {58 vars in 1415 bytes} [Tue May 10 18:00:02 2022] DELETE /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments/9c925312-07a5-47fe-8efa-91771a1a7a34 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 18:00:03.735644 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3f87dfac-4106-48be-9772-884282ebe6af tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:00:03.736622 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3f87dfac-4106-48be-9772-884282ebe6af tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:00:03.742800 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3f87dfac-4106-48be-9772-884282ebe6af tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:03.743250 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3f87dfac-4106-48be-9772-884282ebe6af tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:03.744046 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3f87dfac-4106-48be-9772-884282ebe6af tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:03.744478 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3f87dfac-4106-48be-9772-884282ebe6af tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:03.772794 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3f87dfac-4106-48be-9772-884282ebe6af tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041024 May 10 18:00:03.773342 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 577/1165] 10.222.0.60 () {58 vars in 1301 bytes} [Tue May 10 18:00:03 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 18:00:03.877901 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e060d9dc-f0af-4794-8a65-378c2b8992e4 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:00:03.878942 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e060d9dc-f0af-4794-8a65-378c2b8992e4 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:00:03.885735 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e060d9dc-f0af-4794-8a65-378c2b8992e4 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:03.886188 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e060d9dc-f0af-4794-8a65-378c2b8992e4 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:03.886956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e060d9dc-f0af-4794-8a65-378c2b8992e4 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:03.887469 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e060d9dc-f0af-4794-8a65-378c2b8992e4 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:03.915142 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e060d9dc-f0af-4794-8a65-378c2b8992e4 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041553 May 10 18:00:03.915722 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 589/1166] 10.222.0.60 () {58 vars in 1301 bytes} [Tue May 10 18:00:03 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 10 18:00:03.973156 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ecb1cce3-7cde-481d-8828-92af78607b1a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:00:03.973678 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ecb1cce3-7cde-481d-8828-92af78607b1a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:00:03.979661 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ecb1cce3-7cde-481d-8828-92af78607b1a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:03.980112 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ecb1cce3-7cde-481d-8828-92af78607b1a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:03.980875 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ecb1cce3-7cde-481d-8828-92af78607b1a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:03.981312 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ecb1cce3-7cde-481d-8828-92af78607b1a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:04.005602 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ecb1cce3-7cde-481d-8828-92af78607b1a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 18:00:04.081039 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ecb1cce3-7cde-481d-8828-92af78607b1a tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81" status: 204 len: 0 microversion: 2.1 time: 0.111208 May 10 18:00:04.081905 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 578/1167] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 18:00:03 2022] DELETE /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 18:00:04.090622 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f54dd83e-6c9d-4d0d-9406-b74d79ee20f3 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:00:04.091236 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f54dd83e-6c9d-4d0d-9406-b74d79ee20f3 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:00:04.097145 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f54dd83e-6c9d-4d0d-9406-b74d79ee20f3 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:04.097594 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f54dd83e-6c9d-4d0d-9406-b74d79ee20f3 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:04.098361 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f54dd83e-6c9d-4d0d-9406-b74d79ee20f3 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:04.098799 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f54dd83e-6c9d-4d0d-9406-b74d79ee20f3 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:04.230638 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f54dd83e-6c9d-4d0d-9406-b74d79ee20f3 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:00:04.238014 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f54dd83e-6c9d-4d0d-9406-b74d79ee20f3 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81" status: 200 len: 1671 microversion: 2.1 time: 0.151941 May 10 18:00:04.238595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 590/1168] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:00:04 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:00:05.256267 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-3816256f-042b-42cb-b94d-87e73c469e0e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:00:05.256955 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-3816256f-042b-42cb-b94d-87e73c469e0e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:00:05.263393 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3816256f-042b-42cb-b94d-87e73c469e0e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:05.263856 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3816256f-042b-42cb-b94d-87e73c469e0e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:05.264622 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3816256f-042b-42cb-b94d-87e73c469e0e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:05.265057 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-3816256f-042b-42cb-b94d-87e73c469e0e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:05.397890 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-3816256f-042b-42cb-b94d-87e73c469e0e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:00:05.405322 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-3816256f-042b-42cb-b94d-87e73c469e0e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81" status: 200 len: 1671 microversion: 2.1 time: 0.153355 May 10 18:00:05.405889 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 579/1169] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:00:05 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:00:06.422945 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5dec6d79-cfb6-4c6f-bb0e-ce65dc1f1168 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:00:06.423635 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5dec6d79-cfb6-4c6f-bb0e-ce65dc1f1168 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:00:06.430096 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5dec6d79-cfb6-4c6f-bb0e-ce65dc1f1168 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:06.430552 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5dec6d79-cfb6-4c6f-bb0e-ce65dc1f1168 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:06.431325 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5dec6d79-cfb6-4c6f-bb0e-ce65dc1f1168 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:06.431831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5dec6d79-cfb6-4c6f-bb0e-ce65dc1f1168 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:06.565319 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-5dec6d79-cfb6-4c6f-bb0e-ce65dc1f1168 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:00:06.573318 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-5dec6d79-cfb6-4c6f-bb0e-ce65dc1f1168 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81" status: 200 len: 1671 microversion: 2.1 time: 0.153767 May 10 18:00:06.573904 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 591/1170] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:00:06 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 18:00:07.233257 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-9ffd14c6-b01d-4f2f-8e55-d2066eff2394 req-4160d7f2-ebcc-48fd-8728-b18e9a69bd4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d20a5da-0117-4756-9702-78bf939f6f81", "name": "network-vif-deleted", "tag": "cdf3d2c3-53c7-4f85-9104-e3ff4f413ee1"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 18:00:07.243746 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-9ffd14c6-b01d-4f2f-8e55-d2066eff2394 req-4160d7f2-ebcc-48fd-8728-b18e9a69bd4d service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:07.245150 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-9ffd14c6-b01d-4f2f-8e55-d2066eff2394 req-4160d7f2-ebcc-48fd-8728-b18e9a69bd4d service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:07.256343 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-9ffd14c6-b01d-4f2f-8e55-d2066eff2394 req-4160d7f2-ebcc-48fd-8728-b18e9a69bd4d service nova] Creating event network-vif-deleted:cdf3d2c3-53c7-4f85-9104-e3ff4f413ee1 for instance 4d20a5da-0117-4756-9702-78bf939f6f81 on hv-cinder-84130 May 10 18:00:07.262153 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-9ffd14c6-b01d-4f2f-8e55-d2066eff2394 req-4160d7f2-ebcc-48fd-8728-b18e9a69bd4d service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033453 May 10 18:00:07.262770 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 580/1171] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 18:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 18:00:07.590656 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4e44163f-2bcb-463f-9a12-345dcc226dd8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:00:07.591271 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4e44163f-2bcb-463f-9a12-345dcc226dd8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:00:07.597720 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e44163f-2bcb-463f-9a12-345dcc226dd8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:07.598177 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e44163f-2bcb-463f-9a12-345dcc226dd8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:07.598947 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e44163f-2bcb-463f-9a12-345dcc226dd8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:07.599413 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e44163f-2bcb-463f-9a12-345dcc226dd8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:07.631472 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e44163f-2bcb-463f-9a12-345dcc226dd8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:07.631945 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4e44163f-2bcb-463f-9a12-345dcc226dd8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:07.632395 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.objects.instance [None req-4e44163f-2bcb-463f-9a12-345dcc226dd8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lazy-loading 'fault' on Instance uuid 4d20a5da-0117-4756-9702-78bf939f6f81 {{(pid=123753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 18:00:07.676059 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4e44163f-2bcb-463f-9a12-345dcc226dd8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a1dcd8a84cf4f33b5405ad0279bf2b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a83ced38e3ea471399fe49b3162b38e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:00:07.685509 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4e44163f-2bcb-463f-9a12-345dcc226dd8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81" status: 200 len: 1326 microversion: 2.1 time: 0.099317 May 10 18:00:07.686332 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 592/1172] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:00:07 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 => generated 1326 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:00:08.704709 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6ccc0a47-8d76-4e53-a6fb-6971da3b6a2c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:00:08.705410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-6ccc0a47-8d76-4e53-a6fb-6971da3b6a2c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:00:08.711617 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6ccc0a47-8d76-4e53-a6fb-6971da3b6a2c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:08.712069 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6ccc0a47-8d76-4e53-a6fb-6971da3b6a2c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:08.712835 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6ccc0a47-8d76-4e53-a6fb-6971da3b6a2c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:08.714281 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-6ccc0a47-8d76-4e53-a6fb-6971da3b6a2c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:08.727918 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-6ccc0a47-8d76-4e53-a6fb-6971da3b6a2c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] HTTP exception thrown: Instance 4d20a5da-0117-4756-9702-78bf939f6f81 could not be found. May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6ccc0a47-8d76-4e53-a6fb-6971da3b6a2c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Request method failure captured: May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 HTTP/1.1 May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqZjcgbeBwGH8870PXuS7YXTl04OcdcT45jTdBKbtTz4L_6Uye_AvJ9FJWIkWwdFspQ_Cmn4VEkRK723NNWLDPEkHusY8XLsz9B4Vl9fkIFrHc27k7uIUSComQ13jVFzdjj1MoEGHEKxYiLk72isKs4gLVB2-lcwhqPxP_Gk95afjTk May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: a83ced38e3ea471399fe49b3162b38e7 May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeTestJSON-185127037 May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 18:00:08.730589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 18:00:08.732158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a83ced38e3ea471399fe49b3162b38e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a83ced38e3ea471399fe49b3162b38e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a83ced38e3ea471399fe49b3162b38e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a83ced38e3ea471399fe49b3162b38e7"}]}] May 10 18:00:08.732158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeTestJSON-185127037 May 10 18:00:08.732158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: a83ced38e3ea471399fe49b3162b38e7 May 10 18:00:08.732158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeTestJSON-185127037 May 10 18:00:08.732158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeTestJSON-185127037-project May 10 18:00:08.732158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 18:00:08.732158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 18:00:08.732158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: 6a1dcd8a84cf4f33b5405ad0279bf2b4 May 10 18:00:08.732158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeTestJSON-185127037-project May 10 18:00:08.732158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 18:00:08.732158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance 4d20a5da-0117-4756-9702-78bf939f6f81 could not be found. May 10 18:00:08.732158 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': '4d20a5da-0117-4756-9702-78bf939f6f81'} May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d20a5da-0117-4756-9702-78bf939f6f81 could not be found. May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 18:00:08.732988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 18:00:08.734410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 18:00:08.734410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 18:00:08.734410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 18:00:08.734410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 18:00:08.734410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 18:00:08.734410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 18:00:08.734410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 18:00:08.734410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d20a5da-0117-4756-9702-78bf939f6f81 could not be found. May 10 18:00:08.734410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 18:00:08.734410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 18:00:08.734410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 18:00:08.734410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 18:00:08.734410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 18:00:08.734410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 18:00:08.734410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 18:00:08.734410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 18:00:08.734410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d20a5da-0117-4756-9702-78bf939f6f81 could not be found. May 10 18:00:08.734410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 18:00:08.735655 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-6ccc0a47-8d76-4e53-a6fb-6971da3b6a2c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Returning 404 to user: Instance 4d20a5da-0117-4756-9702-78bf939f6f81 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 18:00:08.735655 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-6ccc0a47-8d76-4e53-a6fb-6971da3b6a2c tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81" status: 404 len: 111 microversion: 2.1 time: 0.032401 May 10 18:00:08.735655 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 581/1173] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:00:08 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 18:00:08.740783 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e56fc81b-62ce-4c3d-92cc-bf2a7869e54f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '.version_select at 0x7f3e7ba7fee0>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:00:08.758298 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e56fc81b-62ce-4c3d-92cc-bf2a7869e54f tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689162653" status: 202 len: 0 microversion: 2.1 time: 0.021221 May 10 18:00:08.759213 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 593/1174] 10.222.0.60 () {58 vars in 1220 bytes} [Tue May 10 18:00:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1689162653 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 18:00:11.613791 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ef02e536-06cf-4ee5-b2fe-6569ddcc0c4d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:00:11.614339 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-ef02e536-06cf-4ee5-b2fe-6569ddcc0c4d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:00:11.621238 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef02e536-06cf-4ee5-b2fe-6569ddcc0c4d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:11.621688 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef02e536-06cf-4ee5-b2fe-6569ddcc0c4d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:11.622449 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef02e536-06cf-4ee5-b2fe-6569ddcc0c4d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:11.622887 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-ef02e536-06cf-4ee5-b2fe-6569ddcc0c4d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:11.636206 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-ef02e536-06cf-4ee5-b2fe-6569ddcc0c4d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] HTTP exception thrown: Instance 4d20a5da-0117-4756-9702-78bf939f6f81 could not be found. May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ef02e536-06cf-4ee5-b2fe-6569ddcc0c4d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Request method failure captured: May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: DELETE /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 HTTP/1.1 May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqZjcgbeBwGH8870PXuS7YXTl04OcdcT45jTdBKbtTz4L_6Uye_AvJ9FJWIkWwdFspQ_Cmn4VEkRK723NNWLDPEkHusY8XLsz9B4Vl9fkIFrHc27k7uIUSComQ13jVFzdjj1MoEGHEKxYiLk72isKs4gLVB2-lcwhqPxP_Gk95afjTk May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: a83ced38e3ea471399fe49b3162b38e7 May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeTestJSON-185127037 May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 18:00:11.637741 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 18:00:11.639467 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a83ced38e3ea471399fe49b3162b38e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a83ced38e3ea471399fe49b3162b38e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a83ced38e3ea471399fe49b3162b38e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a83ced38e3ea471399fe49b3162b38e7"}]}] May 10 18:00:11.639467 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeTestJSON-185127037 May 10 18:00:11.639467 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: a83ced38e3ea471399fe49b3162b38e7 May 10 18:00:11.639467 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeTestJSON-185127037 May 10 18:00:11.639467 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeTestJSON-185127037-project May 10 18:00:11.639467 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 18:00:11.639467 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 18:00:11.639467 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: 6a1dcd8a84cf4f33b5405ad0279bf2b4 May 10 18:00:11.639467 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeTestJSON-185127037-project May 10 18:00:11.639467 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 18:00:11.639467 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance 4d20a5da-0117-4756-9702-78bf939f6f81 could not be found. May 10 18:00:11.639467 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': '4d20a5da-0117-4756-9702-78bf939f6f81'} May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d20a5da-0117-4756-9702-78bf939f6f81 could not be found. May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 18:00:11.640500 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d20a5da-0117-4756-9702-78bf939f6f81 could not be found. May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d20a5da-0117-4756-9702-78bf939f6f81 could not be found. May 10 18:00:11.642068 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 18:00:11.643625 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-ef02e536-06cf-4ee5-b2fe-6569ddcc0c4d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Returning 404 to user: Instance 4d20a5da-0117-4756-9702-78bf939f6f81 could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 18:00:11.643625 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-ef02e536-06cf-4ee5-b2fe-6569ddcc0c4d tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "DELETE /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81" status: 404 len: 111 microversion: 2.1 time: 0.029313 May 10 18:00:11.643625 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 582/1175] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 18:00:11 2022] DELETE /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 18:00:11.648228 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8ad1808f-bf7f-42ac-9dcd-b56bdb2a08a9 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:00:11.648845 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8ad1808f-bf7f-42ac-9dcd-b56bdb2a08a9 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: 4d20a5da-0117-4756-9702-78bf939f6f81] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:00:11.655307 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8ad1808f-bf7f-42ac-9dcd-b56bdb2a08a9 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:11.655795 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8ad1808f-bf7f-42ac-9dcd-b56bdb2a08a9 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:11.656564 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8ad1808f-bf7f-42ac-9dcd-b56bdb2a08a9 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:11.657003 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8ad1808f-bf7f-42ac-9dcd-b56bdb2a08a9 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:11.670662 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-8ad1808f-bf7f-42ac-9dcd-b56bdb2a08a9 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] HTTP exception thrown: Instance 4d20a5da-0117-4756-9702-78bf939f6f81 could not be found. May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8ad1808f-bf7f-42ac-9dcd-b56bdb2a08a9 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Request method failure captured: May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 HTTP/1.1 May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqZjcgbeBwGH8870PXuS7YXTl04OcdcT45jTdBKbtTz4L_6Uye_AvJ9FJWIkWwdFspQ_Cmn4VEkRK723NNWLDPEkHusY8XLsz9B4Vl9fkIFrHc27k7uIUSComQ13jVFzdjj1MoEGHEKxYiLk72isKs4gLVB2-lcwhqPxP_Gk95afjTk May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: a83ced38e3ea471399fe49b3162b38e7 May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-AttachVolumeTestJSON-185127037 May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 18:00:11.672529 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 18:00:11.674048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a83ced38e3ea471399fe49b3162b38e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a83ced38e3ea471399fe49b3162b38e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a83ced38e3ea471399fe49b3162b38e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a83ced38e3ea471399fe49b3162b38e7"}]}] May 10 18:00:11.674048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-AttachVolumeTestJSON-185127037 May 10 18:00:11.674048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: a83ced38e3ea471399fe49b3162b38e7 May 10 18:00:11.674048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-AttachVolumeTestJSON-185127037 May 10 18:00:11.674048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-AttachVolumeTestJSON-185127037-project May 10 18:00:11.674048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 18:00:11.674048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 18:00:11.674048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: 6a1dcd8a84cf4f33b5405ad0279bf2b4 May 10 18:00:11.674048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-AttachVolumeTestJSON-185127037-project May 10 18:00:11.674048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 18:00:11.674048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance 4d20a5da-0117-4756-9702-78bf939f6f81 could not be found. May 10 18:00:11.674048 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': '4d20a5da-0117-4756-9702-78bf939f6f81'} May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d20a5da-0117-4756-9702-78bf939f6f81 could not be found. May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 18:00:11.674956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 18:00:11.676338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 18:00:11.676338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 18:00:11.676338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 18:00:11.676338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 18:00:11.676338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 18:00:11.676338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 18:00:11.676338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 18:00:11.676338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d20a5da-0117-4756-9702-78bf939f6f81 could not be found. May 10 18:00:11.676338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 18:00:11.676338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 18:00:11.676338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 18:00:11.676338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 18:00:11.676338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 18:00:11.676338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 18:00:11.676338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 18:00:11.676338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 18:00:11.676338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d20a5da-0117-4756-9702-78bf939f6f81 could not be found. May 10 18:00:11.676338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 18:00:11.677483 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8ad1808f-bf7f-42ac-9dcd-b56bdb2a08a9 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Returning 404 to user: Instance 4d20a5da-0117-4756-9702-78bf939f6f81 could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 18:00:11.677483 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8ad1808f-bf7f-42ac-9dcd-b56bdb2a08a9 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81" status: 404 len: 111 microversion: 2.1 time: 0.030104 May 10 18:00:11.677483 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 594/1176] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:00:11 2022] GET /compute/v2.1/servers/4d20a5da-0117-4756-9702-78bf939f6f81 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 18:00:12.804718 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-23574d46-cb45-41cf-94d0-b4c49527504e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:00:12.805245 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-23574d46-cb45-41cf-94d0-b4c49527504e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:00:12.812217 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-23574d46-cb45-41cf-94d0-b4c49527504e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:12.812677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-23574d46-cb45-41cf-94d0-b4c49527504e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:12.813459 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-23574d46-cb45-41cf-94d0-b4c49527504e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:12.813900 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-23574d46-cb45-41cf-94d0-b4c49527504e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:12.828690 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.wsgi [None req-23574d46-cb45-41cf-94d0-b4c49527504e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] HTTP exception thrown: Instance f67aef06-0fe1-4ec5-a643-e51baea32b2e could not be found. May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-23574d46-cb45-41cf-94d0-b4c49527504e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Request method failure captured: May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: request: DELETE /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e HTTP/1.1 May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept: application/json May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Accept-Encoding: identity May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Connection: close May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Length: 0 May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Content-Type: application/json May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Host: 10.222.0.60 May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Openstack-System-Scope: None May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: User-Agent: python-urllib3/1.26.9 May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Auth-Token: gAAAAABieqZjcgbeBwGH8870PXuS7YXTl04OcdcT45jTdBKbtTz4L_6Uye_AvJ9FJWIkWwdFspQ_Cmn4VEkRK723NNWLDPEkHusY8XLsz9B4Vl9fkIFrHc27k7uIUSComQ13jVFzdjj1MoEGHEKxYiLk72isKs4gLVB2-lcwhqPxP_Gk95afjTk May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Id: None May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Domain-Name: None May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Identity-Status: Confirmed May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Is-Admin-Project: True May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Id: default May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Domain-Name: Default May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Id: a83ced38e3ea471399fe49b3162b38e7 May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Project-Name: tempest-AttachVolumeTestJSON-185127037 May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Role: member,reader May 10 18:00:12.830256 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Roles: member,reader May 10 18:00:12.831649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a83ced38e3ea471399fe49b3162b38e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a83ced38e3ea471399fe49b3162b38e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a83ced38e3ea471399fe49b3162b38e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a83ced38e3ea471399fe49b3162b38e7"}]}] May 10 18:00:12.831649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant: tempest-AttachVolumeTestJSON-185127037 May 10 18:00:12.831649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Id: a83ced38e3ea471399fe49b3162b38e7 May 10 18:00:12.831649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-Tenant-Name: tempest-AttachVolumeTestJSON-185127037 May 10 18:00:12.831649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User: tempest-AttachVolumeTestJSON-185127037-project May 10 18:00:12.831649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Id: default May 10 18:00:12.831649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Domain-Name: Default May 10 18:00:12.831649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Id: 6a1dcd8a84cf4f33b5405ad0279bf2b4 May 10 18:00:12.831649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: X-User-Name: tempest-AttachVolumeTestJSON-185127037-project May 10 18:00:12.831649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: method: > May 10 18:00:12.831649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: exception: Instance f67aef06-0fe1-4ec5-a643-e51baea32b2e could not be found. May 10 18:00:12.831649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: action_args: {'id': 'f67aef06-0fe1-4ec5-a643-e51baea32b2e'} May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67aef06-0fe1-4ec5-a643-e51baea32b2e could not be found. May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 18:00:12.832410 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67aef06-0fe1-4ec5-a643-e51baea32b2e could not be found. May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67aef06-0fe1-4ec5-a643-e51baea32b2e could not be found. May 10 18:00:12.833649 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR nova.api.openstack.wsgi May 10 18:00:12.834887 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-23574d46-cb45-41cf-94d0-b4c49527504e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Returning 404 to user: Instance f67aef06-0fe1-4ec5-a643-e51baea32b2e could not be found. {{(pid=123752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 18:00:12.834887 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-23574d46-cb45-41cf-94d0-b4c49527504e tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "DELETE /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 404 len: 111 microversion: 2.1 time: 0.030918 May 10 18:00:12.834887 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 583/1177] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 18:00:12 2022] DELETE /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 18:00:12.844933 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f5eaf5cb-dfc3-495d-b5c2-6d7b1028a5c8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:00:12.845541 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f5eaf5cb-dfc3-495d-b5c2-6d7b1028a5c8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] [instance: f67aef06-0fe1-4ec5-a643-e51baea32b2e] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:00:12.852037 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f5eaf5cb-dfc3-495d-b5c2-6d7b1028a5c8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:12.852486 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f5eaf5cb-dfc3-495d-b5c2-6d7b1028a5c8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:12.853252 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f5eaf5cb-dfc3-495d-b5c2-6d7b1028a5c8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:00:12.853690 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f5eaf5cb-dfc3-495d-b5c2-6d7b1028a5c8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:00:12.866841 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-f5eaf5cb-dfc3-495d-b5c2-6d7b1028a5c8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] HTTP exception thrown: Instance f67aef06-0fe1-4ec5-a643-e51baea32b2e could not be found. May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f5eaf5cb-dfc3-495d-b5c2-6d7b1028a5c8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Request method failure captured: May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e HTTP/1.1 May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqZjcgbeBwGH8870PXuS7YXTl04OcdcT45jTdBKbtTz4L_6Uye_AvJ9FJWIkWwdFspQ_Cmn4VEkRK723NNWLDPEkHusY8XLsz9B4Vl9fkIFrHc27k7uIUSComQ13jVFzdjj1MoEGHEKxYiLk72isKs4gLVB2-lcwhqPxP_Gk95afjTk May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: a83ced38e3ea471399fe49b3162b38e7 May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-AttachVolumeTestJSON-185127037 May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 18:00:12.868385 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 18:00:12.870578 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a83ced38e3ea471399fe49b3162b38e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/a83ced38e3ea471399fe49b3162b38e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_a83ced38e3ea471399fe49b3162b38e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/a83ced38e3ea471399fe49b3162b38e7"}]}] May 10 18:00:12.870578 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-AttachVolumeTestJSON-185127037 May 10 18:00:12.870578 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: a83ced38e3ea471399fe49b3162b38e7 May 10 18:00:12.870578 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-AttachVolumeTestJSON-185127037 May 10 18:00:12.870578 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-AttachVolumeTestJSON-185127037-project May 10 18:00:12.870578 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 18:00:12.870578 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 18:00:12.870578 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: 6a1dcd8a84cf4f33b5405ad0279bf2b4 May 10 18:00:12.870578 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-AttachVolumeTestJSON-185127037-project May 10 18:00:12.870578 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 18:00:12.870578 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance f67aef06-0fe1-4ec5-a643-e51baea32b2e could not be found. May 10 18:00:12.870578 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': 'f67aef06-0fe1-4ec5-a643-e51baea32b2e'} May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f67aef06-0fe1-4ec5-a643-e51baea32b2e could not be found. May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 18:00:12.871699 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 18:00:12.873217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 18:00:12.873217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 18:00:12.873217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 18:00:12.873217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 18:00:12.873217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 18:00:12.873217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 18:00:12.873217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 18:00:12.873217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f67aef06-0fe1-4ec5-a643-e51baea32b2e could not be found. May 10 18:00:12.873217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 18:00:12.873217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 18:00:12.873217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 18:00:12.873217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 18:00:12.873217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 18:00:12.873217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 18:00:12.873217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 18:00:12.873217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 18:00:12.873217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f67aef06-0fe1-4ec5-a643-e51baea32b2e could not be found. May 10 18:00:12.873217 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 18:00:12.874727 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f5eaf5cb-dfc3-495d-b5c2-6d7b1028a5c8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] Returning 404 to user: Instance f67aef06-0fe1-4ec5-a643-e51baea32b2e could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 18:00:12.874727 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f5eaf5cb-dfc3-495d-b5c2-6d7b1028a5c8 tempest-AttachVolumeTestJSON-185127037 tempest-AttachVolumeTestJSON-185127037-project] 10.222.0.60 "GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e" status: 404 len: 111 microversion: 2.1 time: 0.028736 May 10 18:00:12.874727 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 595/1178] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:00:12 2022] GET /compute/v2.1/servers/f67aef06-0fe1-4ec5-a643-e51baea32b2e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 10 18:01:25.286854 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 18:01:25.287520 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Tue May 10 18:01:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 18:01:31.688420 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 18:01:31.689033 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Tue May 10 18:01:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 18:01:53.671155 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f2673c3c-d6ee-4451-ad01-5b5afc785d83 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Action: 'create', calling method: .version_select at 0x7f3e76c90ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1863661758", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPp3H1Md9qo7/GLf1+kk66eUsBqP0YxxlrCgB9AyfkkkcF7KWhJzA/kkw8rZckFBQGhuxsN6IbQgxwQAb0bUiRfpFTnrAvDseKSleb9WiT2Z5NQ41CV//j52FrIw5EX/A=="}} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 18:01:53.686728 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-f2673c3c-d6ee-4451-ad01-5b5afc785d83 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Getting quotas for project 550c47b03653401d871922496e1cf055. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 18:01:53.691026 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.quota [None req-f2673c3c-d6ee-4451-ad01-5b5afc785d83 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Getting quotas for user ab98ef11f3714e27a2ba02402d142813 and project 550c47b03653401d871922496e1cf055. Resources: {'key_pairs'} {{(pid=123752) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 18:01:53.731230 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f2673c3c-d6ee-4451-ad01-5b5afc785d83 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.241765 May 10 18:01:53.732430 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 584/1179] 10.222.0.60 () {60 vars in 1158 bytes} [Tue May 10 18:01:53 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 18:02:14.088218 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4783fc01-cc4f-45c8-9197-163536017378] AMQP server on 10.222.0.60:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 10 18:02:14.092601 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-57543414-b15b-4743-9154-a3b3c2b63558 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-881715506", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1863661758", "security_groups": [{"name": "tempest-secgroup-smoke-1842768606"}], "networks": [{"uuid": "38b058c6-b160-4f6e-bc53-5ea76b007ed8"}], "block_device_mapping_v2": [{"uuid": "a55cdc4d-3677-4f0b-81cf-24f00ce3d66f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 18:02:14.202012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.network.neutron [None req-57543414-b15b-4743-9154-a3b3c2b63558 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] validate_networks() for [('38b058c6-b160-4f6e-bc53-5ea76b007ed8', None, None, None, None, None)] {{(pid=123753) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 10 18:02:14.669706 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-57543414-b15b-4743-9154-a3b3c2b63558 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Flavor limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 10 18:02:14.670138 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-57543414-b15b-4743-9154-a3b3c2b63558 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Image limits 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 10 18:02:14.670625 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-57543414-b15b-4743-9154-a3b3c2b63558 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Flavor pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 10 18:02:14.671044 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-57543414-b15b-4743-9154-a3b3c2b63558 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Image pref 0:0:0 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 10 18:02:14.671498 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.virt.hardware [None req-57543414-b15b-4743-9154-a3b3c2b63558 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 10 18:02:14.680474 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-57543414-b15b-4743-9154-a3b3c2b63558 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:14.680925 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-57543414-b15b-4743-9154-a3b3c2b63558 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:14.681724 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-57543414-b15b-4743-9154-a3b3c2b63558 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:14.682159 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-57543414-b15b-4743-9154-a3b3c2b63558 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:14.698509 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-57543414-b15b-4743-9154-a3b3c2b63558 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Getting quotas for project 550c47b03653401d871922496e1cf055. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 10 18:02:14.706030 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.quota [None req-57543414-b15b-4743-9154-a3b3c2b63558 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Getting quotas for user ab98ef11f3714e27a2ba02402d142813 and project 550c47b03653401d871922496e1cf055. Resources: {'ram', 'instances', 'cores'} {{(pid=123753) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 10 18:02:14.764775 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-57543414-b15b-4743-9154-a3b3c2b63558 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Going to run 1 instances... {{(pid=123753) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 10 18:02:14.766889 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-57543414-b15b-4743-9154-a3b3c2b63558 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a55cdc4d-3677-4f0b-81cf-24f00ce3d66f',volume_size=None,volume_type=None)] {{(pid=123753) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 10 18:02:14.891855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-57543414-b15b-4743-9154-a3b3c2b63558 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.805622 May 10 18:02:14.892530 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 596/1180] 10.222.0.60 () {60 vars in 1146 bytes} [Tue May 10 18:02:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 10 18:02:14.902624 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-55b88d52-65dd-46d4-84c9-b0938a90b8cb tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:02:14.904373 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-55b88d52-65dd-46d4-84c9-b0938a90b8cb tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:02:14.959558 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-55b88d52-65dd-46d4-84c9-b0938a90b8cb tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:02:14.966983 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-55b88d52-65dd-46d4-84c9-b0938a90b8cb tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1088 microversion: 2.1 time: 0.068442 May 10 18:02:14.967691 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 585/1181] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:02:14 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1088 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:02:15.987399 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-e0281e57-bb3f-4b3d-adfd-2b48c0f79fac tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:02:15.988001 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-e0281e57-bb3f-4b3d-adfd-2b48c0f79fac tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:02:15.995551 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO oslo.messaging._drivers.impl_rabbit [-] [4783fc01-cc4f-45c8-9197-163536017378] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 40510. May 10 18:02:16.002336 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e0281e57-bb3f-4b3d-adfd-2b48c0f79fac tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:16.002789 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e0281e57-bb3f-4b3d-adfd-2b48c0f79fac tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:16.004358 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e0281e57-bb3f-4b3d-adfd-2b48c0f79fac tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:16.004358 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-e0281e57-bb3f-4b3d-adfd-2b48c0f79fac tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:16.071010 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-e0281e57-bb3f-4b3d-adfd-2b48c0f79fac tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:02:16.080454 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-e0281e57-bb3f-4b3d-adfd-2b48c0f79fac tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1194 microversion: 2.1 time: 0.101253 May 10 18:02:16.081031 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 597/1182] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:02:15 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1194 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:02:17.097418 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-460fd869-7cdc-465f-8e8f-ff5e76d14bf2 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:02:17.098019 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-460fd869-7cdc-465f-8e8f-ff5e76d14bf2 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:02:17.104636 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-460fd869-7cdc-465f-8e8f-ff5e76d14bf2 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:17.105088 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-460fd869-7cdc-465f-8e8f-ff5e76d14bf2 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:17.105943 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-460fd869-7cdc-465f-8e8f-ff5e76d14bf2 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:17.106391 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-460fd869-7cdc-465f-8e8f-ff5e76d14bf2 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:17.238452 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-460fd869-7cdc-465f-8e8f-ff5e76d14bf2 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:02:17.245869 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-460fd869-7cdc-465f-8e8f-ff5e76d14bf2 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1260 microversion: 2.1 time: 0.152342 May 10 18:02:17.246536 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 586/1183] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:02:17 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:02:17.563935 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-000b15c0-16e0-4412-8bdd-c31e88569a44 req-cd66be58-98ca-4ca1-a92b-b6ef37fb4ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e844a78-85e7-4fc9-9d96-0ff0b75da389", "tag": "2f650efb-0692-49a3-9efa-890a5a1cfcc5"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 18:02:17.589953 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-000b15c0-16e0-4412-8bdd-c31e88569a44 req-cd66be58-98ca-4ca1-a92b-b6ef37fb4ae3 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:17.590479 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-000b15c0-16e0-4412-8bdd-c31e88569a44 req-cd66be58-98ca-4ca1-a92b-b6ef37fb4ae3 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:17.603436 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-000b15c0-16e0-4412-8bdd-c31e88569a44 req-cd66be58-98ca-4ca1-a92b-b6ef37fb4ae3 service nova] Creating event network-changed:2f650efb-0692-49a3-9efa-890a5a1cfcc5 for instance 7e844a78-85e7-4fc9-9d96-0ff0b75da389 on hv-cinder-84130 May 10 18:02:17.609447 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-000b15c0-16e0-4412-8bdd-c31e88569a44 req-cd66be58-98ca-4ca1-a92b-b6ef37fb4ae3 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065299 May 10 18:02:17.610425 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 598/1184] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 18:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 18:02:18.262975 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-0a4fcf7f-16c3-4626-9168-98e3a7b2ef49 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:02:18.263614 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-0a4fcf7f-16c3-4626-9168-98e3a7b2ef49 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:02:18.270006 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0a4fcf7f-16c3-4626-9168-98e3a7b2ef49 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:18.270453 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0a4fcf7f-16c3-4626-9168-98e3a7b2ef49 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:18.271213 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0a4fcf7f-16c3-4626-9168-98e3a7b2ef49 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:18.271677 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-0a4fcf7f-16c3-4626-9168-98e3a7b2ef49 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:18.410003 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-0a4fcf7f-16c3-4626-9168-98e3a7b2ef49 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:02:18.417340 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-0a4fcf7f-16c3-4626-9168-98e3a7b2ef49 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1260 microversion: 2.1 time: 0.158892 May 10 18:02:18.417906 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 587/1185] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:02:18 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:02:19.435022 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-067a7ede-5d8f-491a-8e1f-15da14473fef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:02:19.435758 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-067a7ede-5d8f-491a-8e1f-15da14473fef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:02:19.442359 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-067a7ede-5d8f-491a-8e1f-15da14473fef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:19.442802 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-067a7ede-5d8f-491a-8e1f-15da14473fef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:19.443603 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-067a7ede-5d8f-491a-8e1f-15da14473fef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:19.444042 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-067a7ede-5d8f-491a-8e1f-15da14473fef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:19.584547 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-067a7ede-5d8f-491a-8e1f-15da14473fef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:02:19.592727 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-067a7ede-5d8f-491a-8e1f-15da14473fef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1260 microversion: 2.1 time: 0.162251 May 10 18:02:19.593303 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 599/1186] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:02:19 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:02:20.610561 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-216597e6-bd60-4a91-9634-e45db96d8b44 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:02:20.611176 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-216597e6-bd60-4a91-9634-e45db96d8b44 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:02:20.618462 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-216597e6-bd60-4a91-9634-e45db96d8b44 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:20.618947 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-216597e6-bd60-4a91-9634-e45db96d8b44 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:20.620143 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-216597e6-bd60-4a91-9634-e45db96d8b44 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:20.620593 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-216597e6-bd60-4a91-9634-e45db96d8b44 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:20.769007 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-216597e6-bd60-4a91-9634-e45db96d8b44 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:02:20.776475 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-216597e6-bd60-4a91-9634-e45db96d8b44 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1260 microversion: 2.1 time: 0.170836 May 10 18:02:20.777037 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 588/1187] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:02:20 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:02:21.792956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fa58d2f1-5450-48ec-863e-51fb61318f11 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:02:21.794173 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-fa58d2f1-5450-48ec-863e-51fb61318f11 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:02:21.800621 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fa58d2f1-5450-48ec-863e-51fb61318f11 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:21.801074 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fa58d2f1-5450-48ec-863e-51fb61318f11 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:21.801862 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fa58d2f1-5450-48ec-863e-51fb61318f11 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:21.802286 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fa58d2f1-5450-48ec-863e-51fb61318f11 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:21.935308 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fa58d2f1-5450-48ec-863e-51fb61318f11 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:02:21.942982 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-fa58d2f1-5450-48ec-863e-51fb61318f11 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1260 microversion: 2.1 time: 0.153911 May 10 18:02:21.943571 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 600/1188] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:02:21 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:02:22.960078 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-dd70a278-8e96-43b7-9b1d-ac76a706006f tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:02:22.960679 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-dd70a278-8e96-43b7-9b1d-ac76a706006f tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:02:22.967048 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dd70a278-8e96-43b7-9b1d-ac76a706006f tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:22.967530 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dd70a278-8e96-43b7-9b1d-ac76a706006f tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:22.968305 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dd70a278-8e96-43b7-9b1d-ac76a706006f tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:22.968738 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dd70a278-8e96-43b7-9b1d-ac76a706006f tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:23.100182 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-dd70a278-8e96-43b7-9b1d-ac76a706006f tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:02:23.108304 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-dd70a278-8e96-43b7-9b1d-ac76a706006f tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1260 microversion: 2.1 time: 0.152105 May 10 18:02:23.108883 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 589/1189] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:02:22 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:02:24.125704 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-0d6acc01-6393-45ce-ac2a-342983c0e739 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:02:24.126292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-0d6acc01-6393-45ce-ac2a-342983c0e739 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:02:24.133218 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0d6acc01-6393-45ce-ac2a-342983c0e739 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:24.133671 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0d6acc01-6393-45ce-ac2a-342983c0e739 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:24.134543 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0d6acc01-6393-45ce-ac2a-342983c0e739 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:24.135026 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-0d6acc01-6393-45ce-ac2a-342983c0e739 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:24.272851 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-0d6acc01-6393-45ce-ac2a-342983c0e739 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:02:24.281664 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-0d6acc01-6393-45ce-ac2a-342983c0e739 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1260 microversion: 2.1 time: 0.160918 May 10 18:02:24.282292 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 601/1190] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:02:24 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 18:02:25.299054 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-af58f1c1-1159-4474-b13b-2b10b34ba63e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:02:25.299708 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-af58f1c1-1159-4474-b13b-2b10b34ba63e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:02:25.306120 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af58f1c1-1159-4474-b13b-2b10b34ba63e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:25.306580 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af58f1c1-1159-4474-b13b-2b10b34ba63e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:25.307347 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af58f1c1-1159-4474-b13b-2b10b34ba63e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:25.307815 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-af58f1c1-1159-4474-b13b-2b10b34ba63e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:25.444034 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-af58f1c1-1159-4474-b13b-2b10b34ba63e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:02:25.451774 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-af58f1c1-1159-4474-b13b-2b10b34ba63e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1260 microversion: 2.1 time: 0.156538 May 10 18:02:25.452355 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 590/1191] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:02:25 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:02:26.469243 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-3e97b4bc-ab64-4069-9736-4884d90ba101 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:02:26.469842 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-3e97b4bc-ab64-4069-9736-4884d90ba101 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:02:26.476376 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3e97b4bc-ab64-4069-9736-4884d90ba101 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:26.476821 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3e97b4bc-ab64-4069-9736-4884d90ba101 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:26.477587 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3e97b4bc-ab64-4069-9736-4884d90ba101 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:26.478024 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3e97b4bc-ab64-4069-9736-4884d90ba101 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:26.615956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-3e97b4bc-ab64-4069-9736-4884d90ba101 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:02:26.625033 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-3e97b4bc-ab64-4069-9736-4884d90ba101 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1260 microversion: 2.1 time: 0.159635 May 10 18:02:26.625614 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 602/1192] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:02:26 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:02:27.642494 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bdff1945-c485-4b17-b812-6d844fce41c6 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:02:27.643089 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-bdff1945-c485-4b17-b812-6d844fce41c6 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:02:27.649521 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bdff1945-c485-4b17-b812-6d844fce41c6 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:27.649972 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bdff1945-c485-4b17-b812-6d844fce41c6 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:27.650749 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bdff1945-c485-4b17-b812-6d844fce41c6 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:27.651190 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bdff1945-c485-4b17-b812-6d844fce41c6 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:27.782200 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-bdff1945-c485-4b17-b812-6d844fce41c6 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:02:27.789528 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bdff1945-c485-4b17-b812-6d844fce41c6 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1260 microversion: 2.1 time: 0.151000 May 10 18:02:27.790101 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 591/1193] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:02:27 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:02:28.808255 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-33d8d6d0-5fa9-4cab-b021-992a767a8790 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:02:28.810322 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-33d8d6d0-5fa9-4cab-b021-992a767a8790 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:02:28.821337 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-33d8d6d0-5fa9-4cab-b021-992a767a8790 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:28.822123 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-33d8d6d0-5fa9-4cab-b021-992a767a8790 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:28.823532 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-33d8d6d0-5fa9-4cab-b021-992a767a8790 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:28.824370 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-33d8d6d0-5fa9-4cab-b021-992a767a8790 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:28.837087 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-ef5e2866-b75b-45ff-a2e1-20bf33162d2b req-abba4290-f7e9-4b2b-8b9c-547b0ece5e3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e844a78-85e7-4fc9-9d96-0ff0b75da389", "name": "network-vif-plugged", "status": "completed", "tag": "2f650efb-0692-49a3-9efa-890a5a1cfcc5"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 18:02:28.849274 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-ef5e2866-b75b-45ff-a2e1-20bf33162d2b req-abba4290-f7e9-4b2b-8b9c-547b0ece5e3b service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:28.850008 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-ef5e2866-b75b-45ff-a2e1-20bf33162d2b req-abba4290-f7e9-4b2b-8b9c-547b0ece5e3b service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:28.863690 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-ef5e2866-b75b-45ff-a2e1-20bf33162d2b req-abba4290-f7e9-4b2b-8b9c-547b0ece5e3b service nova] Creating event network-vif-plugged:2f650efb-0692-49a3-9efa-890a5a1cfcc5 for instance 7e844a78-85e7-4fc9-9d96-0ff0b75da389 on hv-cinder-84130 May 10 18:02:28.869390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-ef5e2866-b75b-45ff-a2e1-20bf33162d2b req-abba4290-f7e9-4b2b-8b9c-547b0ece5e3b service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108629 May 10 18:02:28.870061 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 603/1194] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 18:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 18:02:28.971970 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-33d8d6d0-5fa9-4cab-b021-992a767a8790 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:02:28.979734 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-33d8d6d0-5fa9-4cab-b021-992a767a8790 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1260 microversion: 2.1 time: 0.175982 May 10 18:02:28.980309 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 592/1195] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:02:28 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:02:29.998661 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fc7d63ae-cc91-455f-b1aa-14291dca969e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:02:29.999390 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-fc7d63ae-cc91-455f-b1aa-14291dca969e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:02:30.005594 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fc7d63ae-cc91-455f-b1aa-14291dca969e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:30.006038 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fc7d63ae-cc91-455f-b1aa-14291dca969e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:30.006802 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fc7d63ae-cc91-455f-b1aa-14291dca969e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:30.007239 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fc7d63ae-cc91-455f-b1aa-14291dca969e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:30.140436 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fc7d63ae-cc91-455f-b1aa-14291dca969e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:02:30.148239 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-fc7d63ae-cc91-455f-b1aa-14291dca969e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1260 microversion: 2.1 time: 0.154914 May 10 18:02:30.148803 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 604/1196] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:02:29 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:02:31.166063 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-50cf4d7c-d33b-41f3-88aa-184cc63a0680 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:02:31.166670 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-50cf4d7c-d33b-41f3-88aa-184cc63a0680 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:02:31.173161 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-50cf4d7c-d33b-41f3-88aa-184cc63a0680 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:31.173618 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-50cf4d7c-d33b-41f3-88aa-184cc63a0680 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:31.174391 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-50cf4d7c-d33b-41f3-88aa-184cc63a0680 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:31.174833 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-50cf4d7c-d33b-41f3-88aa-184cc63a0680 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:31.304652 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-50cf4d7c-d33b-41f3-88aa-184cc63a0680 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:02:31.312706 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-50cf4d7c-d33b-41f3-88aa-184cc63a0680 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1443 microversion: 2.1 time: 0.150615 May 10 18:02:31.313271 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 593/1197] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:02:31 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1443 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:02:31.329848 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-3eb36a06-e66e-4137-b900-4147078b8120 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:02:31.330299 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-3eb36a06-e66e-4137-b900-4147078b8120 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:02:31.336882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3eb36a06-e66e-4137-b900-4147078b8120 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:31.337335 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3eb36a06-e66e-4137-b900-4147078b8120 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:31.338141 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3eb36a06-e66e-4137-b900-4147078b8120 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:31.338583 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-3eb36a06-e66e-4137-b900-4147078b8120 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:31.473332 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-3eb36a06-e66e-4137-b900-4147078b8120 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:02:31.481293 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-3eb36a06-e66e-4137-b900-4147078b8120 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1443 microversion: 2.1 time: 0.155244 May 10 18:02:31.481864 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 605/1198] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:02:31 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:02:33.301096 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-6c3485e1-f756-482c-a68f-2e3b132a49a2 req-58c0d1b3-51e7-47aa-a135-56b4fb4b8576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e844a78-85e7-4fc9-9d96-0ff0b75da389", "tag": "2f650efb-0692-49a3-9efa-890a5a1cfcc5"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 18:02:33.309364 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-6c3485e1-f756-482c-a68f-2e3b132a49a2 req-58c0d1b3-51e7-47aa-a135-56b4fb4b8576 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:02:33.309814 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-6c3485e1-f756-482c-a68f-2e3b132a49a2 req-58c0d1b3-51e7-47aa-a135-56b4fb4b8576 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:02:33.321088 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-6c3485e1-f756-482c-a68f-2e3b132a49a2 req-58c0d1b3-51e7-47aa-a135-56b4fb4b8576 service nova] Creating event network-changed:2f650efb-0692-49a3-9efa-890a5a1cfcc5 for instance 7e844a78-85e7-4fc9-9d96-0ff0b75da389 on hv-cinder-84130 May 10 18:02:33.325270 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR oslo.messaging._drivers.impl_rabbit [req-6c3485e1-f756-482c-a68f-2e3b132a49a2 req-58c0d1b3-51e7-47aa-a135-56b4fb4b8576 service nova] [ce76f602-aee4-47f4-88f6-66d5ef2f8ffb] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 18:02:34.335173 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [req-6c3485e1-f756-482c-a68f-2e3b132a49a2 req-58c0d1b3-51e7-47aa-a135-56b4fb4b8576 service nova] [ce76f602-aee4-47f4-88f6-66d5ef2f8ffb] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 40560. May 10 18:02:34.339419 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-6c3485e1-f756-482c-a68f-2e3b132a49a2 req-58c0d1b3-51e7-47aa-a135-56b4fb4b8576 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.097076 May 10 18:02:34.340813 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 594/1199] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 18:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 18:02:56.366147 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 18:02:56.366907 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Tue May 10 18:02:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 18:04:45.294751 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 18:04:45.295471 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Tue May 10 18:04:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 18:04:47.143955 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-996fb48b-c5ad-481e-bc1f-4fc50fc2b6b8 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 18:04:47.144512 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-996fb48b-c5ad-481e-bc1f-4fc50fc2b6b8 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:04:47.150424 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-996fb48b-c5ad-481e-bc1f-4fc50fc2b6b8 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:47.150949 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-996fb48b-c5ad-481e-bc1f-4fc50fc2b6b8 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:47.151824 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-996fb48b-c5ad-481e-bc1f-4fc50fc2b6b8 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:47.152264 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-996fb48b-c5ad-481e-bc1f-4fc50fc2b6b8 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:47.175643 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.objects.instance [None req-996fb48b-c5ad-481e-bc1f-4fc50fc2b6b8 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lazy-loading 'flavor' on Instance uuid 7e844a78-85e7-4fc9-9d96-0ff0b75da389 {{(pid=123753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 10 18:04:47.248833 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-996fb48b-c5ad-481e-bc1f-4fc50fc2b6b8 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "POST /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389/action" status: 202 len: 0 microversion: 2.1 time: 0.110523 May 10 18:04:47.249453 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 606/1200] 10.222.0.60 () {60 vars in 1277 bytes} [Tue May 10 18:04:47 2022] POST /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 18:04:47.255926 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: ERROR oslo.messaging._drivers.impl_rabbit [-] [228c9021-2435-4e7b-93bd-7f0be323ef67] AMQP server on 10.222.0.60:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 10 18:04:47.260083 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-f3ab7d7b-8ec6-443f-b992-68afc4592c90 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:04:47.260773 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-f3ab7d7b-8ec6-443f-b992-68afc4592c90 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:04:47.267886 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f3ab7d7b-8ec6-443f-b992-68afc4592c90 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:47.268339 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f3ab7d7b-8ec6-443f-b992-68afc4592c90 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:47.269111 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f3ab7d7b-8ec6-443f-b992-68afc4592c90 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:47.269551 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-f3ab7d7b-8ec6-443f-b992-68afc4592c90 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:47.450930 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-f3ab7d7b-8ec6-443f-b992-68afc4592c90 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:04:47.459136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-f3ab7d7b-8ec6-443f-b992-68afc4592c90 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1568 microversion: 2.1 time: 0.204952 May 10 18:04:47.459740 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 595/1201] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:04:47 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:04:48.477956 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-bac1f1ca-c24c-4647-9b8c-f307436003ae tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:04:48.478676 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-bac1f1ca-c24c-4647-9b8c-f307436003ae tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:04:48.485622 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bac1f1ca-c24c-4647-9b8c-f307436003ae tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:48.486066 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bac1f1ca-c24c-4647-9b8c-f307436003ae tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:48.486823 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bac1f1ca-c24c-4647-9b8c-f307436003ae tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:48.487257 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-bac1f1ca-c24c-4647-9b8c-f307436003ae tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:48.668107 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-bac1f1ca-c24c-4647-9b8c-f307436003ae tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:04:48.675879 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-bac1f1ca-c24c-4647-9b8c-f307436003ae tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1568 microversion: 2.1 time: 0.202798 May 10 18:04:48.676447 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 607/1202] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:04:48 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:04:49.691931 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-19e6b0b4-1162-4a7b-8b2a-bb9779f9fffc tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:04:49.692539 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-19e6b0b4-1162-4a7b-8b2a-bb9779f9fffc tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:04:49.699663 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19e6b0b4-1162-4a7b-8b2a-bb9779f9fffc tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:49.700116 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19e6b0b4-1162-4a7b-8b2a-bb9779f9fffc tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:49.700888 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19e6b0b4-1162-4a7b-8b2a-bb9779f9fffc tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:49.701329 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-19e6b0b4-1162-4a7b-8b2a-bb9779f9fffc tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:49.723029 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [-] [228c9021-2435-4e7b-93bd-7f0be323ef67] Reconnected to AMQP server on 10.222.0.60:5672 via [amqp] client with port 40620. May 10 18:04:49.833543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-19e6b0b4-1162-4a7b-8b2a-bb9779f9fffc tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:04:49.841006 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-19e6b0b4-1162-4a7b-8b2a-bb9779f9fffc tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1568 microversion: 2.1 time: 0.152924 May 10 18:04:49.841570 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 596/1203] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:04:49 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:04:50.858207 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-40fc2e05-8b6b-4fa5-b222-c15c0b81d9ef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:04:50.858938 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-40fc2e05-8b6b-4fa5-b222-c15c0b81d9ef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:04:50.865328 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-40fc2e05-8b6b-4fa5-b222-c15c0b81d9ef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:50.865783 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-40fc2e05-8b6b-4fa5-b222-c15c0b81d9ef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:50.866550 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-40fc2e05-8b6b-4fa5-b222-c15c0b81d9ef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:50.866992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-40fc2e05-8b6b-4fa5-b222-c15c0b81d9ef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:50.995487 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-40fc2e05-8b6b-4fa5-b222-c15c0b81d9ef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:04:51.003733 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-40fc2e05-8b6b-4fa5-b222-c15c0b81d9ef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1568 microversion: 2.1 time: 0.149589 May 10 18:04:51.004299 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 608/1204] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:04:50 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:04:51.696479 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 18:04:51.696729 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Tue May 10 18:04:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 18:04:52.021136 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-122de43e-45c6-4eba-b9e9-e7ee5bc2e15f tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:04:52.021671 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-122de43e-45c6-4eba-b9e9-e7ee5bc2e15f tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:04:52.027988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-122de43e-45c6-4eba-b9e9-e7ee5bc2e15f tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:52.028438 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-122de43e-45c6-4eba-b9e9-e7ee5bc2e15f tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:52.029196 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-122de43e-45c6-4eba-b9e9-e7ee5bc2e15f tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:52.029630 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-122de43e-45c6-4eba-b9e9-e7ee5bc2e15f tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:52.161270 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-122de43e-45c6-4eba-b9e9-e7ee5bc2e15f tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:04:52.168854 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-122de43e-45c6-4eba-b9e9-e7ee5bc2e15f tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1568 microversion: 2.1 time: 0.151748 May 10 18:04:52.169424 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 597/1205] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:04:52 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:04:53.186238 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-225eff05-2a41-4b4e-99c5-9c54b7e13629 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:04:53.187474 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-225eff05-2a41-4b4e-99c5-9c54b7e13629 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:04:53.193865 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-225eff05-2a41-4b4e-99c5-9c54b7e13629 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:53.194316 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-225eff05-2a41-4b4e-99c5-9c54b7e13629 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:53.195081 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-225eff05-2a41-4b4e-99c5-9c54b7e13629 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:53.195560 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-225eff05-2a41-4b4e-99c5-9c54b7e13629 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:53.323530 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-225eff05-2a41-4b4e-99c5-9c54b7e13629 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:04:53.332270 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-225eff05-2a41-4b4e-99c5-9c54b7e13629 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1568 microversion: 2.1 time: 0.149899 May 10 18:04:53.332833 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 609/1206] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:04:53 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:04:54.348989 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-bbafc5c8-9a66-43f9-9aa7-0757a51cf2ef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:04:54.349601 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-bbafc5c8-9a66-43f9-9aa7-0757a51cf2ef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:04:54.356010 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bbafc5c8-9a66-43f9-9aa7-0757a51cf2ef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:54.356469 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bbafc5c8-9a66-43f9-9aa7-0757a51cf2ef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:54.357234 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bbafc5c8-9a66-43f9-9aa7-0757a51cf2ef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:54.357678 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-bbafc5c8-9a66-43f9-9aa7-0757a51cf2ef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:54.491559 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-bbafc5c8-9a66-43f9-9aa7-0757a51cf2ef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:04:54.498881 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-bbafc5c8-9a66-43f9-9aa7-0757a51cf2ef tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1568 microversion: 2.1 time: 0.153772 May 10 18:04:54.500052 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 598/1207] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:04:54 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:04:55.516738 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b3759f72-9351-4cb7-ba42-217a9eaecfc4 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:04:55.517382 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-b3759f72-9351-4cb7-ba42-217a9eaecfc4 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:04:55.523847 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b3759f72-9351-4cb7-ba42-217a9eaecfc4 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:55.524309 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b3759f72-9351-4cb7-ba42-217a9eaecfc4 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:55.525077 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b3759f72-9351-4cb7-ba42-217a9eaecfc4 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:55.525514 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b3759f72-9351-4cb7-ba42-217a9eaecfc4 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:55.652166 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b3759f72-9351-4cb7-ba42-217a9eaecfc4 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:04:55.659419 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b3759f72-9351-4cb7-ba42-217a9eaecfc4 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1568 microversion: 2.1 time: 0.147096 May 10 18:04:55.659984 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 610/1208] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:04:55 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:04:56.676447 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e9651720-185c-4435-9512-5fd450b0c180 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:04:56.677055 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e9651720-185c-4435-9512-5fd450b0c180 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:04:56.683534 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e9651720-185c-4435-9512-5fd450b0c180 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:56.683992 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e9651720-185c-4435-9512-5fd450b0c180 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:56.684753 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e9651720-185c-4435-9512-5fd450b0c180 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:56.685200 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e9651720-185c-4435-9512-5fd450b0c180 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:56.815498 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e9651720-185c-4435-9512-5fd450b0c180 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:04:56.822852 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e9651720-185c-4435-9512-5fd450b0c180 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1568 microversion: 2.1 time: 0.150372 May 10 18:04:56.823422 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 599/1209] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:04:56 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:04:57.841211 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-652ca478-7b33-4fdf-a089-508285e23a52 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:04:57.841888 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-652ca478-7b33-4fdf-a089-508285e23a52 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:04:57.848856 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-652ca478-7b33-4fdf-a089-508285e23a52 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:57.849308 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-652ca478-7b33-4fdf-a089-508285e23a52 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:57.850066 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-652ca478-7b33-4fdf-a089-508285e23a52 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:57.850500 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-652ca478-7b33-4fdf-a089-508285e23a52 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:57.985595 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-652ca478-7b33-4fdf-a089-508285e23a52 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:04:57.993033 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-652ca478-7b33-4fdf-a089-508285e23a52 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1568 microversion: 2.1 time: 0.155674 May 10 18:04:57.993592 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 611/1210] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:04:57 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:04:59.010080 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-43fdc400-3e7d-420d-8855-b72b55972707 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:04:59.010683 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-43fdc400-3e7d-420d-8855-b72b55972707 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:04:59.017152 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-43fdc400-3e7d-420d-8855-b72b55972707 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:59.017600 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-43fdc400-3e7d-420d-8855-b72b55972707 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:59.018394 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-43fdc400-3e7d-420d-8855-b72b55972707 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:04:59.018831 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-43fdc400-3e7d-420d-8855-b72b55972707 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:04:59.144435 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-43fdc400-3e7d-420d-8855-b72b55972707 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:04:59.151684 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-43fdc400-3e7d-420d-8855-b72b55972707 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1568 microversion: 2.1 time: 0.145409 May 10 18:04:59.152246 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 600/1211] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:04:59 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:05:00.169398 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-9fe350ac-bd6e-4b97-9f89-92abb5d92603 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:05:00.170004 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-9fe350ac-bd6e-4b97-9f89-92abb5d92603 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:05:00.176929 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9fe350ac-bd6e-4b97-9f89-92abb5d92603 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:00.177382 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9fe350ac-bd6e-4b97-9f89-92abb5d92603 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:00.178162 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9fe350ac-bd6e-4b97-9f89-92abb5d92603 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:00.178606 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-9fe350ac-bd6e-4b97-9f89-92abb5d92603 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:00.315388 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-9fe350ac-bd6e-4b97-9f89-92abb5d92603 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:05:00.323124 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-9fe350ac-bd6e-4b97-9f89-92abb5d92603 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1569 microversion: 2.1 time: 0.157629 May 10 18:05:00.323726 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 612/1212] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:05:00 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:05:00.340270 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-39e164d9-828b-46e5-9d3a-7e091410ae27 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 18:05:00.340846 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-39e164d9-828b-46e5-9d3a-7e091410ae27 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:05:00.347724 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-39e164d9-828b-46e5-9d3a-7e091410ae27 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:00.348184 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-39e164d9-828b-46e5-9d3a-7e091410ae27 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:00.348961 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-39e164d9-828b-46e5-9d3a-7e091410ae27 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:00.349406 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-39e164d9-828b-46e5-9d3a-7e091410ae27 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:00.483988 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-39e164d9-828b-46e5-9d3a-7e091410ae27 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "POST /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389/action" status: 202 len: 0 microversion: 2.1 time: 0.147338 May 10 18:05:00.485910 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 601/1213] 10.222.0.60 () {60 vars in 1277 bytes} [Tue May 10 18:05:00 2022] POST /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 18:05:00.494669 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-d44fb83c-6061-417b-81d3-1c976b3e0719 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:05:00.494669 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-d44fb83c-6061-417b-81d3-1c976b3e0719 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:05:00.519318 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d44fb83c-6061-417b-81d3-1c976b3e0719 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:00.519803 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d44fb83c-6061-417b-81d3-1c976b3e0719 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:00.521064 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d44fb83c-6061-417b-81d3-1c976b3e0719 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:00.521552 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-d44fb83c-6061-417b-81d3-1c976b3e0719 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:00.662572 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-d44fb83c-6061-417b-81d3-1c976b3e0719 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:05:00.670110 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-d44fb83c-6061-417b-81d3-1c976b3e0719 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1577 microversion: 2.1 time: 0.179925 May 10 18:05:00.670665 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 613/1214] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:05:00 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:05:01.688541 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-2a53cf99-1996-4e8c-9d02-7bb950738f9c tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:05:01.689153 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-2a53cf99-1996-4e8c-9d02-7bb950738f9c tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:05:01.695446 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2a53cf99-1996-4e8c-9d02-7bb950738f9c tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:01.695899 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2a53cf99-1996-4e8c-9d02-7bb950738f9c tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:01.696783 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2a53cf99-1996-4e8c-9d02-7bb950738f9c tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:01.697321 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-2a53cf99-1996-4e8c-9d02-7bb950738f9c tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:01.837115 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-2a53cf99-1996-4e8c-9d02-7bb950738f9c tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:05:01.844915 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-2a53cf99-1996-4e8c-9d02-7bb950738f9c tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1519 microversion: 2.1 time: 0.161109 May 10 18:05:01.845413 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 602/1215] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:05:01 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:05:02.862729 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-1f9b7515-b154-4f48-b530-54d003d7410c tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:05:02.863342 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-1f9b7515-b154-4f48-b530-54d003d7410c tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:05:02.869776 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1f9b7515-b154-4f48-b530-54d003d7410c tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:02.870226 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1f9b7515-b154-4f48-b530-54d003d7410c tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:02.870983 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1f9b7515-b154-4f48-b530-54d003d7410c tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:02.871441 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-1f9b7515-b154-4f48-b530-54d003d7410c tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:02.999289 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-1f9b7515-b154-4f48-b530-54d003d7410c tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:05:03.006880 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-1f9b7515-b154-4f48-b530-54d003d7410c tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1575 microversion: 2.1 time: 0.148747 May 10 18:05:03.007452 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 614/1216] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:05:02 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:05:03.451011 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-eb14da94-a41b-4c69-9ff4-5aebc2a10760 req-7fe849ce-6990-4ccf-a386-ffe774cdf50c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e844a78-85e7-4fc9-9d96-0ff0b75da389", "name": "network-vif-unplugged", "status": "completed", "tag": "2f650efb-0692-49a3-9efa-890a5a1cfcc5"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 18:05:03.461060 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-eb14da94-a41b-4c69-9ff4-5aebc2a10760 req-7fe849ce-6990-4ccf-a386-ffe774cdf50c service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:03.461490 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-eb14da94-a41b-4c69-9ff4-5aebc2a10760 req-7fe849ce-6990-4ccf-a386-ffe774cdf50c service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:03.473411 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-eb14da94-a41b-4c69-9ff4-5aebc2a10760 req-7fe849ce-6990-4ccf-a386-ffe774cdf50c service nova] Creating event network-vif-unplugged:2f650efb-0692-49a3-9efa-890a5a1cfcc5 for instance 7e844a78-85e7-4fc9-9d96-0ff0b75da389 on hv-cinder-84130 May 10 18:05:03.478489 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-eb14da94-a41b-4c69-9ff4-5aebc2a10760 req-7fe849ce-6990-4ccf-a386-ffe774cdf50c service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031178 May 10 18:05:03.479082 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 603/1217] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 18:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 18:05:04.025201 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-fbdd6887-9b84-432f-99fa-e2f068ac0e60 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:05:04.025824 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-fbdd6887-9b84-432f-99fa-e2f068ac0e60 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:05:04.033034 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fbdd6887-9b84-432f-99fa-e2f068ac0e60 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:04.033491 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fbdd6887-9b84-432f-99fa-e2f068ac0e60 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:04.034276 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fbdd6887-9b84-432f-99fa-e2f068ac0e60 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:04.034724 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-fbdd6887-9b84-432f-99fa-e2f068ac0e60 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:04.166283 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-fbdd6887-9b84-432f-99fa-e2f068ac0e60 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:05:04.178103 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-fbdd6887-9b84-432f-99fa-e2f068ac0e60 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1575 microversion: 2.1 time: 0.158763 May 10 18:05:04.178691 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 615/1218] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:05:04 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:05:05.197890 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-9ad74902-c6ee-42b8-90f9-1e328a38095e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:05:05.198589 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-9ad74902-c6ee-42b8-90f9-1e328a38095e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:05:05.205835 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ad74902-c6ee-42b8-90f9-1e328a38095e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:05.206292 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ad74902-c6ee-42b8-90f9-1e328a38095e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:05.207052 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ad74902-c6ee-42b8-90f9-1e328a38095e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:05.207523 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-9ad74902-c6ee-42b8-90f9-1e328a38095e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:05.338262 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-9ad74902-c6ee-42b8-90f9-1e328a38095e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:05:05.345687 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-9ad74902-c6ee-42b8-90f9-1e328a38095e tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1575 microversion: 2.1 time: 0.152368 May 10 18:05:05.346229 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 604/1219] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:05:05 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:05:06.363111 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-4068b438-09df-482c-871d-8c0985f26e69 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:05:06.363738 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-4068b438-09df-482c-871d-8c0985f26e69 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:05:06.370186 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4068b438-09df-482c-871d-8c0985f26e69 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:06.370632 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4068b438-09df-482c-871d-8c0985f26e69 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:06.371410 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4068b438-09df-482c-871d-8c0985f26e69 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:06.371849 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-4068b438-09df-482c-871d-8c0985f26e69 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:06.499226 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-4068b438-09df-482c-871d-8c0985f26e69 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:05:06.507148 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-4068b438-09df-482c-871d-8c0985f26e69 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1575 microversion: 2.1 time: 0.148468 May 10 18:05:06.507732 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 616/1220] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:05:06 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:05:07.524364 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-48bb42bd-32d3-4b67-a09c-ea5b4f04caea tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:05:07.525011 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-48bb42bd-32d3-4b67-a09c-ea5b4f04caea tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:05:07.531393 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-48bb42bd-32d3-4b67-a09c-ea5b4f04caea tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:07.531845 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-48bb42bd-32d3-4b67-a09c-ea5b4f04caea tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:07.532619 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-48bb42bd-32d3-4b67-a09c-ea5b4f04caea tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:07.533060 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-48bb42bd-32d3-4b67-a09c-ea5b4f04caea tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:07.664127 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-48bb42bd-32d3-4b67-a09c-ea5b4f04caea tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:05:07.671543 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-48bb42bd-32d3-4b67-a09c-ea5b4f04caea tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1575 microversion: 2.1 time: 0.151061 May 10 18:05:07.672155 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 605/1221] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:05:07 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:05:08.688865 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-b70c4e2c-bec7-424a-9f54-649b1eea3b17 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:05:08.689475 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-b70c4e2c-bec7-424a-9f54-649b1eea3b17 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:05:08.695831 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b70c4e2c-bec7-424a-9f54-649b1eea3b17 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:08.696276 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b70c4e2c-bec7-424a-9f54-649b1eea3b17 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:08.697032 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b70c4e2c-bec7-424a-9f54-649b1eea3b17 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:08.697467 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-b70c4e2c-bec7-424a-9f54-649b1eea3b17 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:08.825832 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-b70c4e2c-bec7-424a-9f54-649b1eea3b17 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:05:08.834125 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-b70c4e2c-bec7-424a-9f54-649b1eea3b17 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1575 microversion: 2.1 time: 0.149485 May 10 18:05:08.834721 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 617/1222] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:05:08 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:05:09.851869 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-b7ea7846-c4b7-4b62-a861-e1e8675326ad tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:05:09.852482 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-b7ea7846-c4b7-4b62-a861-e1e8675326ad tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:05:09.858849 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b7ea7846-c4b7-4b62-a861-e1e8675326ad tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:09.859328 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b7ea7846-c4b7-4b62-a861-e1e8675326ad tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:09.860125 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b7ea7846-c4b7-4b62-a861-e1e8675326ad tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:09.861238 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-b7ea7846-c4b7-4b62-a861-e1e8675326ad tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:09.990979 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-b7ea7846-c4b7-4b62-a861-e1e8675326ad tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:05:09.998377 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-b7ea7846-c4b7-4b62-a861-e1e8675326ad tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1575 microversion: 2.1 time: 0.150446 May 10 18:05:09.998967 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 606/1223] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:05:09 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:05:11.015288 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-8156aadd-cc4c-4caf-9c32-ce22934ee111 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:05:11.015921 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-8156aadd-cc4c-4caf-9c32-ce22934ee111 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:05:11.022632 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8156aadd-cc4c-4caf-9c32-ce22934ee111 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:11.023110 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8156aadd-cc4c-4caf-9c32-ce22934ee111 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:11.023933 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8156aadd-cc4c-4caf-9c32-ce22934ee111 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:11.024399 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-8156aadd-cc4c-4caf-9c32-ce22934ee111 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:11.436262 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-8156aadd-cc4c-4caf-9c32-ce22934ee111 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:05:11.444357 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-8156aadd-cc4c-4caf-9c32-ce22934ee111 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1575 microversion: 2.1 time: 0.433029 May 10 18:05:11.445257 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 618/1224] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:05:11 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1575 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:05:12.461368 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-e58a4118-c2a0-4a9b-8842-b169632e66d4 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:05:12.461982 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-e58a4118-c2a0-4a9b-8842-b169632e66d4 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:05:12.468301 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e58a4118-c2a0-4a9b-8842-b169632e66d4 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:12.468752 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e58a4118-c2a0-4a9b-8842-b169632e66d4 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:12.469549 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e58a4118-c2a0-4a9b-8842-b169632e66d4 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:12.470069 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-e58a4118-c2a0-4a9b-8842-b169632e66d4 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:12.596655 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-e58a4118-c2a0-4a9b-8842-b169632e66d4 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:05:12.604023 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-e58a4118-c2a0-4a9b-8842-b169632e66d4 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1562 microversion: 2.1 time: 0.146581 May 10 18:05:12.604587 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 607/1225] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:05:12 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1562 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:05:13.555169 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-8dca8a63-049f-4c2b-acd0-c34ab01f72b3 req-7de6fa5a-a861-4dae-b632-57dc06716753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e844a78-85e7-4fc9-9d96-0ff0b75da389", "name": "network-vif-plugged", "status": "completed", "tag": "2f650efb-0692-49a3-9efa-890a5a1cfcc5"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 18:05:13.565249 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-8dca8a63-049f-4c2b-acd0-c34ab01f72b3 req-7de6fa5a-a861-4dae-b632-57dc06716753 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:05:13.565697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-8dca8a63-049f-4c2b-acd0-c34ab01f72b3 req-7de6fa5a-a861-4dae-b632-57dc06716753 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:05:13.581168 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-8dca8a63-049f-4c2b-acd0-c34ab01f72b3 req-7de6fa5a-a861-4dae-b632-57dc06716753 service nova] Creating event network-vif-plugged:2f650efb-0692-49a3-9efa-890a5a1cfcc5 for instance 7e844a78-85e7-4fc9-9d96-0ff0b75da389 on hv-cinder-84130 May 10 18:05:13.586320 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-8dca8a63-049f-4c2b-acd0-c34ab01f72b3 req-7de6fa5a-a861-4dae-b632-57dc06716753 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034846 May 10 18:05:13.587241 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 619/1226] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 18:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 18:06:03.688709 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 18:06:03.689389 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Tue May 10 18:06:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 18:06:42.532122 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-df9ba283-ed6f-4e07-9027-4607e52f89fd tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:06:42.532687 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-df9ba283-ed6f-4e07-9027-4607e52f89fd tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:06:42.533543 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [req-f0aa803c-3b25-4ffd-8ce0-39c2f0bb06a4 req-4c5a57d8-1571-4468-9706-7757a955fa78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e844a78-85e7-4fc9-9d96-0ff0b75da389", "tag": "2f650efb-0692-49a3-9efa-890a5a1cfcc5"}]} {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 18:06:42.539016 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-df9ba283-ed6f-4e07-9027-4607e52f89fd tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:06:42.539574 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-df9ba283-ed6f-4e07-9027-4607e52f89fd tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:06:42.540412 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-df9ba283-ed6f-4e07-9027-4607e52f89fd tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:06:42.541228 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-df9ba283-ed6f-4e07-9027-4607e52f89fd tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:06:42.541882 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-f0aa803c-3b25-4ffd-8ce0-39c2f0bb06a4 req-4c5a57d8-1571-4468-9706-7757a955fa78 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:06:42.542338 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [req-f0aa803c-3b25-4ffd-8ce0-39c2f0bb06a4 req-4c5a57d8-1571-4468-9706-7757a955fa78 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:06:42.554556 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.compute.server_external_events [req-f0aa803c-3b25-4ffd-8ce0-39c2f0bb06a4 req-4c5a57d8-1571-4468-9706-7757a955fa78 service nova] Creating event network-changed:2f650efb-0692-49a3-9efa-890a5a1cfcc5 for instance 7e844a78-85e7-4fc9-9d96-0ff0b75da389 on hv-cinder-84130 May 10 18:06:42.561697 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [req-f0aa803c-3b25-4ffd-8ce0-39c2f0bb06a4 req-4c5a57d8-1571-4468-9706-7757a955fa78 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032208 May 10 18:06:42.562482 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 620/1227] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 18:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 10 18:06:42.567952 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-df9ba283-ed6f-4e07-9027-4607e52f89fd tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Going to try to terminate instance {{(pid=123752) delete /opt/stack/nova/nova/compute/api.py:2664}} May 10 18:06:42.655257 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-df9ba283-ed6f-4e07-9027-4607e52f89fd tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "DELETE /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 204 len: 0 microversion: 2.1 time: 0.127493 May 10 18:06:42.656360 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 608/1228] 10.222.0.60 () {58 vars in 1238 bytes} [Tue May 10 18:06:42 2022] DELETE /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 10 18:06:42.666003 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-f80f7669-5c3d-42ad-9861-f85ed679c433 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:06:42.666717 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-f80f7669-5c3d-42ad-9861-f85ed679c433 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:06:42.676661 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f80f7669-5c3d-42ad-9861-f85ed679c433 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:06:42.676661 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f80f7669-5c3d-42ad-9861-f85ed679c433 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:06:42.677244 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f80f7669-5c3d-42ad-9861-f85ed679c433 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:06:42.677680 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-f80f7669-5c3d-42ad-9861-f85ed679c433 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:06:42.820346 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-f80f7669-5c3d-42ad-9861-f85ed679c433 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:06:42.828739 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-f80f7669-5c3d-42ad-9861-f85ed679c433 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1568 microversion: 2.1 time: 0.167378 May 10 18:06:42.829320 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 621/1229] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:06:42 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:06:43.847152 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-dea9b5e6-97e3-4069-9aa8-98b3aa508d86 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:06:43.848065 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.compute.api [None req-dea9b5e6-97e3-4069-9aa8-98b3aa508d86 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123752) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:06:43.854168 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dea9b5e6-97e3-4069-9aa8-98b3aa508d86 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:06:43.854625 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dea9b5e6-97e3-4069-9aa8-98b3aa508d86 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:06:43.855423 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dea9b5e6-97e3-4069-9aa8-98b3aa508d86 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:06:43.855863 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [None req-dea9b5e6-97e3-4069-9aa8-98b3aa508d86 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:06:43.989440 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.policy [None req-dea9b5e6-97e3-4069-9aa8-98b3aa508d86 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123752) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:06:43.996882 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-dea9b5e6-97e3-4069-9aa8-98b3aa508d86 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1568 microversion: 2.1 time: 0.153934 May 10 18:06:43.997446 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 609/1230] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:06:43 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 10 18:06:45.014420 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-5055e155-554d-4a35-be61-000fa114f6ee tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:06:45.015052 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-5055e155-554d-4a35-be61-000fa114f6ee tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:06:45.023145 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5055e155-554d-4a35-be61-000fa114f6ee tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:06:45.023653 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5055e155-554d-4a35-be61-000fa114f6ee tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:06:45.024462 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5055e155-554d-4a35-be61-000fa114f6ee tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:06:45.025152 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-5055e155-554d-4a35-be61-000fa114f6ee tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:06:45.094778 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [req-bc4edd2c-3e27-4528-991e-5a71015c10a1 req-911ae313-221c-4ea9-8e74-8c54d85fe5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e844a78-85e7-4fc9-9d96-0ff0b75da389", "name": "network-vif-deleted", "tag": "2f650efb-0692-49a3-9efa-890a5a1cfcc5"}]} {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 10 18:06:45.099175 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.policy [None req-5055e155-554d-4a35-be61-000fa114f6ee tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab98ef11f3714e27a2ba02402d142813', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '550c47b03653401d871922496e1cf055', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123753) authorize /opt/stack/nova/nova/policy.py:199}} May 10 18:06:45.103383 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-bc4edd2c-3e27-4528-991e-5a71015c10a1 req-911ae313-221c-4ea9-8e74-8c54d85fe5c2 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:06:45.103857 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG oslo_concurrency.lockutils [req-bc4edd2c-3e27-4528-991e-5a71015c10a1 req-911ae313-221c-4ea9-8e74-8c54d85fe5c2 service nova] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:06:45.108775 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-5055e155-554d-4a35-be61-000fa114f6ee tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 200 len: 1381 microversion: 2.1 time: 0.098585 May 10 18:06:45.118430 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 622/1231] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:06:45 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 1381 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 10 18:06:45.118622 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.compute.server_external_events [req-bc4edd2c-3e27-4528-991e-5a71015c10a1 req-911ae313-221c-4ea9-8e74-8c54d85fe5c2 service nova] Creating event network-vif-deleted:2f650efb-0692-49a3-9efa-890a5a1cfcc5 for instance 7e844a78-85e7-4fc9-9d96-0ff0b75da389 on hv-cinder-84130 May 10 18:06:45.120893 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [req-bc4edd2c-3e27-4528-991e-5a71015c10a1 req-911ae313-221c-4ea9-8e74-8c54d85fe5c2 service nova] 10.222.0.60 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092165 May 10 18:06:45.121492 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 610/1232] 10.222.0.60 () {64 vars in 1317 bytes} [Tue May 10 18:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 10 18:06:46.127090 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-240bf8a2-0c40-4acb-988a-d74ca37fe2a9 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '>' {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:06:46.127681 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.compute.api [None req-240bf8a2-0c40-4acb-988a-d74ca37fe2a9 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] [instance: 7e844a78-85e7-4fc9-9d96-0ff0b75da389] Fetching instance by UUID {{(pid=123753) get /opt/stack/nova/nova/compute/api.py:2920}} May 10 18:06:46.133751 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-240bf8a2-0c40-4acb-988a-d74ca37fe2a9 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:06:46.134207 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-240bf8a2-0c40-4acb-988a-d74ca37fe2a9 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:06:46.134983 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-240bf8a2-0c40-4acb-988a-d74ca37fe2a9 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 10 18:06:46.135455 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG oslo_concurrency.lockutils [None req-240bf8a2-0c40-4acb-988a-d74ca37fe2a9 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Lock "4cf72ab4-47d9-469e-9ed6-e0c2d75e0a87" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123753) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 10 18:06:46.148368 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.wsgi [None req-240bf8a2-0c40-4acb-988a-d74ca37fe2a9 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] HTTP exception thrown: Instance 7e844a78-85e7-4fc9-9d96-0ff0b75da389 could not be found. May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-240bf8a2-0c40-4acb-988a-d74ca37fe2a9 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Request method failure captured: May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: request: GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 HTTP/1.1 May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept: application/json May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Accept-Encoding: identity May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Connection: close May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Length: 0 May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Content-Type: application/json May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Host: 10.222.0.60 May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Openstack-System-Scope: None May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: User-Agent: python-urllib3/1.26.9 May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Auth-Token: gAAAAABieqiMuzckQ2opxlSiEtFKgcBv2xXksnKRC7CgUgrfsYGq2ylS__uFR5HkVR5RQSsJu4k14dSDOHk8NSJ-GYgnO2j21v9TD6y9oLgLwXnFi-YhH88HVhWVNY1ClvC6Awd80qxa2b3hsc0QhfxS97fvWOyf0G1KJf_FdXWVy9sW_JMM5ls May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Id: None May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Domain-Name: None May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Identity-Status: Confirmed May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Is-Admin-Project: True May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Id: default May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Domain-Name: Default May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Id: 550c47b03653401d871922496e1cf055 May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Project-Name: tempest-TestShelveInstance-530547604 May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Role: member,reader May 10 18:06:46.150012 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Roles: member,reader May 10 18:06:46.151855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/550c47b03653401d871922496e1cf055"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2/550c47b03653401d871922496e1cf055"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.60:8080", "publicURL": "http://10.222.0.60:8080/v1/AUTH_550c47b03653401d871922496e1cf055"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.60/volume/v3/550c47b03653401d871922496e1cf055"}]}] May 10 18:06:46.151855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant: tempest-TestShelveInstance-530547604 May 10 18:06:46.151855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Id: 550c47b03653401d871922496e1cf055 May 10 18:06:46.151855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-Tenant-Name: tempest-TestShelveInstance-530547604 May 10 18:06:46.151855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User: tempest-TestShelveInstance-530547604-project May 10 18:06:46.151855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Id: default May 10 18:06:46.151855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Domain-Name: Default May 10 18:06:46.151855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Id: ab98ef11f3714e27a2ba02402d142813 May 10 18:06:46.151855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: X-User-Name: tempest-TestShelveInstance-530547604-project May 10 18:06:46.151855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: method: > May 10 18:06:46.151855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: exception: Instance 7e844a78-85e7-4fc9-9d96-0ff0b75da389 could not be found. May 10 18:06:46.151855 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: action_args: {'id': '7e844a78-85e7-4fc9-9d96-0ff0b75da389'} May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: {{(pid=123753) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e844a78-85e7-4fc9-9d96-0ff0b75da389 could not be found. May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 10 18:06:46.152992 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 10 18:06:46.154899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 10 18:06:46.154899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 10 18:06:46.154899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 10 18:06:46.154899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 10 18:06:46.154899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 10 18:06:46.154899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 10 18:06:46.154899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 10 18:06:46.154899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e844a78-85e7-4fc9-9d96-0ff0b75da389 could not be found. May 10 18:06:46.154899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 18:06:46.154899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 10 18:06:46.154899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 18:06:46.154899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 10 18:06:46.154899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 10 18:06:46.154899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 10 18:06:46.154899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 10 18:06:46.154899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 10 18:06:46.154899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e844a78-85e7-4fc9-9d96-0ff0b75da389 could not be found. May 10 18:06:46.154899 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: ERROR nova.api.openstack.wsgi May 10 18:06:46.156708 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: DEBUG nova.api.openstack.wsgi [None req-240bf8a2-0c40-4acb-988a-d74ca37fe2a9 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Returning 404 to user: Instance 7e844a78-85e7-4fc9-9d96-0ff0b75da389 could not be found. {{(pid=123753) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 10 18:06:46.156708 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO nova.api.openstack.requestlog [None req-240bf8a2-0c40-4acb-988a-d74ca37fe2a9 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389" status: 404 len: 111 microversion: 2.1 time: 0.028918 May 10 18:06:46.156708 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: [pid: 123753|app: 0|req: 623/1233] 10.222.0.60 () {58 vars in 1235 bytes} [Tue May 10 18:06:46 2022] GET /compute/v2.1/servers/7e844a78-85e7-4fc9-9d96-0ff0b75da389 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 10 18:06:46.308347 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: DEBUG nova.api.openstack.wsgi [None req-c8f45f98-ddad-4cc3-ac33-2432033232b4 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] Calling method '.version_select at 0x7f3e775a4d30>' {{(pid=123752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 10 18:06:46.330087 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO nova.api.openstack.requestlog [None req-c8f45f98-ddad-4cc3-ac33-2432033232b4 tempest-TestShelveInstance-530547604 tempest-TestShelveInstance-530547604-project] 10.222.0.60 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1863661758" status: 202 len: 0 microversion: 2.1 time: 0.026495 May 10 18:06:46.330957 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: [pid: 123752|app: 0|req: 611/1234] 10.222.0.60 () {58 vars in 1253 bytes} [Tue May 10 18:06:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1863661758 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 10 18:07:56.376874 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 18:07:56.377708 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Tue May 10 18:07:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 18:08:11.704730 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 18:08:11.705236 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Tue May 10 18:08:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 18:09:23.696401 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 18:09:23.697117 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Tue May 10 18:09:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 18:09:45.305113 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 18:09:45.305724 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Tue May 10 18:09:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 18:09:58.240667 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 18:09:58.241274 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Tue May 10 18:09:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 18:10:05.076460 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 18:10:05.077049 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Tue May 10 18:10:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 18:11:16.385459 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 18:11:16.386226 dv-cinder-841302-2-iscsi devstack@n-api.service[123752]: Tue May 10 18:11:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 10 18:11:31.713943 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 10 18:11:31.714435 dv-cinder-841302-2-iscsi devstack@n-api.service[123753]: Tue May 10 18:11:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!